Jul 16 20:30:52.647007 ip-10-0-137-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 20:30:52.647038 ip-10-0-137-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 20:30:52.647045 ip-10-0-137-238 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 20:30:52.647250 ip-10-0-137-238 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 20:31:02.896877 ip-10-0-137-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 20:31:02.896899 ip-10-0-137-238 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot db4cddcffcf74d43b4fae7124cd980f5 -- Jul 16 20:32:56.631171 ip-10-0-137-238 systemd[1]: Starting Kubernetes Kubelet... Jul 16 20:32:57.004274 ip-10-0-137-238 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:32:57.004274 ip-10-0-137-238 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 20:32:57.004274 ip-10-0-137-238 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:32:57.004274 ip-10-0-137-238 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 20:32:57.004274 ip-10-0-137-238 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 20:32:57.004950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.004858 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 20:32:57.009159 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009143 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.009159 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009158 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009164 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009168 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009171 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009179 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009189 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009192 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009195 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009198 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009201 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009204 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009206 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009209 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009211 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009214 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009217 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009219 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009222 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.009218 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009225 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009229 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009233 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009235 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009238 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009241 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009243 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009246 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009248 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009250 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009253 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009256 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009258 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009260 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009263 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009265 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009268 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009294 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009298 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009302 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.009676 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009305 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009307 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009310 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009313 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009316 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009318 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009321 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009323 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009326 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009328 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009330 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009333 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009335 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009337 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009341 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009343 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009346 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009349 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009352 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009354 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.010175 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009356 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009359 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009361 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009365 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009368 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009371 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009374 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009376 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009379 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009381 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009384 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009386 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009389 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009391 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009394 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009396 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009398 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009401 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009403 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.010654 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009405 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009408 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009410 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009413 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009415 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009417 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009420 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009423 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009426 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009428 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009432 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009435 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009437 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009440 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009442 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009445 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009447 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009449 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009452 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009455 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.011122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.009457 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010127 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010133 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010137 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010140 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010142 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010149 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010152 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010154 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010157 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010160 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010162 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010164 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010167 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010169 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010172 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010174 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010177 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010179 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010183 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.011594 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010186 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010191 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010195 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010198 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010200 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010203 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010206 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010209 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010212 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010214 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010217 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010219 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010222 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010224 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010226 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010229 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010231 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010234 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010236 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.012119 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010239 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010242 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010244 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010247 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010249 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010253 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010256 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010259 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010262 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010264 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010267 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010269 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010272 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010276 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010278 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010281 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010283 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010286 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010289 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.012578 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010291 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010294 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010297 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010299 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010302 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010304 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010306 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010309 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010312 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010314 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010316 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010319 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010321 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010323 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010326 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010329 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010331 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010333 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010336 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010338 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.013080 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010355 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010358 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010361 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010364 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010367 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010371 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010374 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010377 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010380 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010382 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010386 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010388 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010390 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010393 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010397 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010400 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010403 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010405 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010408 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010410 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.013574 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010413 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010415 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010761 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010765 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010768 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010770 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010773 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010776 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010778 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010781 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010785 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010787 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010789 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010792 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010794 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010797 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010799 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010804 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010806 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010809 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.014076 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010811 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010814 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010816 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010818 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010821 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010823 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010826 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010828 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010831 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010833 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010836 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010838 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010840 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010843 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010846 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010848 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010850 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010853 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010855 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010858 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.014553 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010860 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010862 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010865 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010867 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010869 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010872 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010874 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010876 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010879 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010885 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010888 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010891 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010894 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010897 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010916 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010918 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010921 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010925 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010929 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.015037 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010931 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010934 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010936 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010939 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010941 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010944 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010946 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010949 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010951 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010954 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010956 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010958 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010961 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010963 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010966 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010968 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010971 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010974 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010976 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010978 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.015492 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010981 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010983 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010987 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010990 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010993 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010995 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.010997 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011000 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011002 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011005 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011007 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011010 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011012 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011014 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011017 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011019 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011022 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011025 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011028 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011031 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.015992 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011035 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011038 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011105 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011112 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011118 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011124 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011132 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011139 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011146 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011155 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011158 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011161 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011165 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011168 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011172 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011175 2563 flags.go:64] FLAG: --cgroup-root="" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011178 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011180 2563 flags.go:64] FLAG: --client-ca-file="" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011183 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011186 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011190 2563 flags.go:64] FLAG: --cluster-domain="" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011192 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011195 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011198 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 20:32:57.016470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011201 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011205 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011207 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011210 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011213 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011216 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011219 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011222 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011224 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011227 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011231 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011234 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011237 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011239 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011242 2563 flags.go:64] FLAG: --enable-server="true" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011245 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011250 2563 flags.go:64] FLAG: --event-burst="100" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011252 2563 flags.go:64] FLAG: --event-qps="50" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011255 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011258 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011260 2563 flags.go:64] FLAG: --eviction-hard="" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011264 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011268 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011271 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011273 2563 flags.go:64] FLAG: --eviction-soft="" Jul 16 20:32:57.017053 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011276 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011279 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011282 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011284 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011287 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011290 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011292 2563 flags.go:64] FLAG: --feature-gates="" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011296 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011299 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011301 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011304 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011307 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011310 2563 flags.go:64] FLAG: --help="false" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011313 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011316 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011319 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011321 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011324 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011328 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011330 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011333 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011335 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011338 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 20:32:57.017662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011347 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011350 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011353 2563 flags.go:64] FLAG: --kube-reserved="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011356 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011360 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011363 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011367 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011370 2563 flags.go:64] FLAG: --lock-file="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011372 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011375 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011378 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011383 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011385 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011388 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011390 2563 flags.go:64] FLAG: --logging-format="text" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011393 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011396 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011399 2563 flags.go:64] FLAG: --manifest-url="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011401 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011405 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011408 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011411 2563 flags.go:64] FLAG: --max-pods="110" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011414 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011417 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011419 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 20:32:57.018381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011423 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011425 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011428 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011431 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011437 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011440 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011443 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011445 2563 flags.go:64] FLAG: --pod-cidr="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011448 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011453 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011456 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011460 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011463 2563 flags.go:64] FLAG: --port="10250" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011466 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011470 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0afb1746be6fbfe34" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011472 2563 flags.go:64] FLAG: --qos-reserved="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011475 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011478 2563 flags.go:64] FLAG: --register-node="true" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011480 2563 flags.go:64] FLAG: --register-with-taints="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011484 2563 flags.go:64] FLAG: --registry-burst="10" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011487 2563 flags.go:64] FLAG: --registry-qps="5" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011489 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011492 2563 flags.go:64] FLAG: --reserved-memory="" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011495 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011498 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 20:32:57.019451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011501 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011504 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011506 2563 flags.go:64] FLAG: --runonce="false" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011509 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011511 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011514 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011517 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011519 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011522 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011525 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011527 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011530 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011532 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011535 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011537 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011540 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011548 2563 flags.go:64] FLAG: --system-cgroups="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011551 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011557 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011560 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011562 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011571 2563 flags.go:64] FLAG: --tls-min-version="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011574 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011576 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011579 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 20:32:57.020502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011581 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011584 2563 flags.go:64] FLAG: --v="2" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011588 2563 flags.go:64] FLAG: --version="false" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011591 2563 flags.go:64] FLAG: --vmodule="" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011595 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.011598 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011708 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011712 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011714 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011717 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011720 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011722 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011725 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011727 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011730 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011738 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011742 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011745 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011748 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011750 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011753 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.021661 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011755 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011758 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011760 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011768 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011772 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011775 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011777 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011781 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011783 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011785 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011788 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011790 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011793 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011795 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011798 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011800 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011802 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011805 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011807 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011809 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.022287 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011812 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011814 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011817 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011819 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011821 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011823 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011826 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011828 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011831 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011833 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011835 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011838 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011840 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011842 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011845 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011847 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011856 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011859 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011861 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.023057 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011866 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011869 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011872 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011874 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011877 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011879 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011882 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011884 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011887 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011889 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011892 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011894 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011897 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011912 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011915 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011918 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011920 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011923 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011925 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011928 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.023705 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011930 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011933 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011935 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011938 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011940 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011942 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011945 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011947 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011950 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011953 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011963 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011966 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011968 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011971 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011973 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011976 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011978 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011981 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011983 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.024235 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011985 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011988 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011990 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011994 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.011997 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.012000 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.012594 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.020353 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.020370 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.020395 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.020404 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020483 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020490 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020495 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.024697 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020499 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020503 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020507 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020512 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020517 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020521 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020525 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020530 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020534 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020539 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020543 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020548 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020553 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020557 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020561 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020565 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020570 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020575 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020579 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020583 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.025077 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020588 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020592 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020596 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020600 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020606 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020612 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020621 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020627 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020632 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020637 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020641 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020645 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020649 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020653 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020657 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020661 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020666 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020670 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.025652 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020674 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020678 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020683 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020686 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020690 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020695 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020701 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020706 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020710 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020714 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020719 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020723 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020727 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020732 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020736 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020740 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020744 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020749 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020753 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.026122 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020756 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020762 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020767 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020771 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020775 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020779 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020783 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020787 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020791 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020795 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020799 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020803 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020807 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020811 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020815 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020819 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020824 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020828 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020831 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020835 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.026584 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020839 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020843 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020847 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020851 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020855 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020859 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020863 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020867 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020871 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020876 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020880 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020884 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020888 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020892 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020896 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020920 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020924 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020928 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.027079 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.020932 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.020939 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021159 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021168 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021174 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021178 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021183 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021187 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021191 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021196 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021200 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021206 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021213 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021217 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021223 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 20:32:57.027511 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021227 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021231 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021235 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021239 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021243 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021247 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021252 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021256 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021260 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021265 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021269 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021274 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021278 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021282 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021286 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021291 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021295 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021302 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021307 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 20:32:57.028020 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021312 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021317 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021321 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021325 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021329 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021333 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021337 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021342 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021346 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021350 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021354 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021358 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021362 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021366 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021370 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021374 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021379 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021383 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021388 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021392 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 20:32:57.028476 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021396 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021400 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021404 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021408 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021414 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021420 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021424 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021429 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021433 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021438 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021442 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021446 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021450 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021454 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021458 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021462 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021466 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021470 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021474 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 20:32:57.028981 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021478 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021482 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021486 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021490 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021495 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021499 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021503 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021507 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021511 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021515 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021519 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021523 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021527 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021531 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021535 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021539 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021544 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021548 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021553 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 20:32:57.029445 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021557 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021561 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021565 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021569 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021574 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021578 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021582 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021586 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:57.021590 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.021598 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.021737 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.025207 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.026439 2563 server.go:1019] "Starting client certificate rotation" Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.026548 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 20:32:57.029938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.027250 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 20:32:57.030289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.029638 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 20:32:57.030919 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.030882 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 20:32:57.040638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.040624 2563 log.go:25] "Validated CRI v1 runtime API" Jul 16 20:32:57.044104 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.044089 2563 log.go:25] "Validated CRI v1 image API" Jul 16 20:32:57.046431 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.046416 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 20:32:57.048614 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.048597 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 804625a3-18ca-4f47-8704-cc394098dbe7:/dev/nvme0n1p3 f28dc48c-a384-4d68-8663-88eb6219a6e1:/dev/nvme0n1p4] Jul 16 20:32:57.048667 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.048613 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 20:32:57.053459 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.053349 2563 manager.go:216] Machine: {Timestamp:2026-07-16 20:32:57.05209297 +0000 UTC m=+0.311052410 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102358 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec254ea5843ce265ca8517b90084af32 SystemUUID:ec254ea5-843c-e265-ca85-17b90084af32 BootID:db4cddcf-fcf7-4d43-b4fa-e7124cd980f5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:ee:c4:cf:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:ee:c4:cf:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:73:ab:91:cd:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 20:32:57.053459 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.053450 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 20:32:57.053579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.053519 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 20:32:57.054113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.054099 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 20:32:57.056400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.056377 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 20:32:57.056662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.056404 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 20:32:57.057404 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.057343 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 20:32:57.057484 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.057465 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 20:32:57.057529 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.057478 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 20:32:57.058382 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.058321 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 20:32:57.059675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.059660 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 20:32:57.062411 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062399 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 20:32:57.062518 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062509 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 20:32:57.062560 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062537 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 16 20:32:57.062560 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062547 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 20:32:57.062560 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062560 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 20:32:57.062672 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062569 2563 kubelet.go:398] "Adding apiserver pod source" Jul 16 20:32:57.062672 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062578 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 20:32:57.062931 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062918 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 20:32:57.062974 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.062945 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 20:32:57.064795 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.064774 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 20:32:57.066503 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.066489 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 20:32:57.066569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.066519 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 20:32:57.067975 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.067964 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.067980 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.067985 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.067991 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068000 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068005 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 20:32:57.068013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068013 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 20:32:57.068174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068018 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 20:32:57.068174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068025 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 20:32:57.068174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068031 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 20:32:57.068174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068039 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 20:32:57.068174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068044 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 20:32:57.068940 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068930 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 20:32:57.068940 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.068940 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 20:32:57.072106 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.072091 2563 server.go:1268] "Started kubelet" Jul 16 20:32:57.072224 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.072201 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 20:32:57.072292 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.072235 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 20:32:57.072292 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.072246 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 20:32:57.072292 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.072266 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 20:32:57.072440 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.072397 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 20:32:57.072514 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.072500 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 20:32:57.073927 ip-10-0-137-238 systemd[1]: Started Kubernetes Kubelet. Jul 16 20:32:57.074555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.074223 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 20:32:57.075563 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.075539 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 16 20:32:57.077097 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.077073 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qdrhs" Jul 16 20:32:57.077361 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.077333 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 20:32:57.077799 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.076518 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-238.ec2.internal.18c2df594f90156b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-238.ec2.internal,UID:ip-10-0-137-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-238.ec2.internal,},FirstTimestamp:2026-07-16 20:32:57.072063851 +0000 UTC m=+0.331023294,LastTimestamp:2026-07-16 20:32:57.072063851 +0000 UTC m=+0.331023294,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-238.ec2.internal,}" Jul 16 20:32:57.080877 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.080863 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 20:32:57.080956 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.080874 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 20:32:57.081009 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.080958 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.081537 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081441 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 20:32:57.081537 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081457 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 20:32:57.081537 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081442 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 20:32:57.081710 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081635 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 16 20:32:57.081710 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081643 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 16 20:32:57.081785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081747 2563 factory.go:55] Registering systemd factory Jul 16 20:32:57.081785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081764 2563 factory.go:223] Registration of the systemd container factory successfully Jul 16 20:32:57.082633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081981 2563 factory.go:153] Registering CRI-O factory Jul 16 20:32:57.082633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.081997 2563 factory.go:223] Registration of the crio container factory successfully Jul 16 20:32:57.082633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.082047 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 20:32:57.082633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.082065 2563 factory.go:103] Registering Raw factory Jul 16 20:32:57.082633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.082074 2563 manager.go:1196] Started watching for new ooms in manager Jul 16 20:32:57.083005 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.082821 2563 manager.go:349] Starting recovery of all containers Jul 16 20:32:57.083409 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.083151 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qdrhs" Jul 16 20:32:57.083634 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.083611 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 20:32:57.083735 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.083701 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 20:32:57.094840 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.094816 2563 manager.go:354] Recovery completed Jul 16 20:32:57.098827 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.098815 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.100472 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.100457 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.100519 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.100485 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.100519 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.100495 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.101068 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101050 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 20:32:57.101154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101069 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 20:32:57.101154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101086 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 20:32:57.101154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101094 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.101742 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101729 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.101779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101753 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.101779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.101762 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.102393 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.102381 2563 policy_none.go:49] "None policy: Start" Jul 16 20:32:57.102457 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.102399 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 20:32:57.102457 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.102412 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 20:32:57.103554 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.103541 2563 policy_none.go:47] "Start" Jul 16 20:32:57.139680 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.139530 2563 manager.go:337] "Starting Device Plugin manager" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.139701 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.139715 2563 server.go:87] "Starting device plugin registration server" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.139925 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.139937 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.140040 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.140148 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.140163 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.140572 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 20:32:57.150339 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.140636 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.241038 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.241017 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.241791 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.241775 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.241857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.241804 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.241857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.241815 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.241857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.241842 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.249878 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.249865 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.249931 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.249887 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-238.ec2.internal\": node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.252083 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.252058 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 20:32:57.253397 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.253379 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 20:32:57.253463 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.253415 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 20:32:57.253463 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.253439 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 20:32:57.253540 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.253469 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 20:32:57.255941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.255875 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:32:57.270767 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.270752 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.353885 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.353858 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal"] Jul 16 20:32:57.353959 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.353939 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.355297 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.355282 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.355368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.355308 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.355368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.355317 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.356601 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.356589 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.356725 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.356698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.356780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.356747 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.357314 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357298 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.357380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357300 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.357380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357354 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.357380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357364 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.357494 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357327 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.357494 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.357400 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.358473 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.358458 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.358518 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.358485 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 20:32:57.359183 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.359167 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientMemory" Jul 16 20:32:57.359183 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.359188 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 20:32:57.359317 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.359202 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeHasSufficientPID" Jul 16 20:32:57.371175 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.371149 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.383027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.383009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.383091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.383032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d1d3d8045e69f5dc2de7b2abaabfdb2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-238.ec2.internal\" (UID: \"1d1d3d8045e69f5dc2de7b2abaabfdb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.383091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.383050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.386441 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.386428 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-238.ec2.internal\" not found" node="ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.390562 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.390547 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-238.ec2.internal\" not found" node="ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.471551 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.471509 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.483618 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.483733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.483733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d1d3d8045e69f5dc2de7b2abaabfdb2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-238.ec2.internal\" (UID: \"1d1d3d8045e69f5dc2de7b2abaabfdb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.483733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d1d3d8045e69f5dc2de7b2abaabfdb2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-238.ec2.internal\" (UID: \"1d1d3d8045e69f5dc2de7b2abaabfdb2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.483733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483694 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.483733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.483714 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd73a2fbeab4f18374893621c83610ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal\" (UID: \"fd73a2fbeab4f18374893621c83610ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.571898 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.571849 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.672427 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.672393 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.689859 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.689832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.692980 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.692964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.773250 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.773219 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.873802 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:57.873752 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-238.ec2.internal\" not found" Jul 16 20:32:57.950773 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.950748 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:32:57.955675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.955661 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:32:57.981489 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.981471 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" Jul 16 20:32:57.992687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.992667 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 20:32:57.993747 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:57.993734 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" Jul 16 20:32:58.001748 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.001730 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 20:32:58.026872 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.026852 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 20:32:58.027239 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.026972 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 20:32:58.027239 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.026972 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 20:32:58.027239 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.026971 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 20:32:58.063174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.063154 2563 apiserver.go:52] "Watching apiserver" Jul 16 20:32:58.080782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.080762 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 20:32:58.080986 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.080972 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 20:32:58.081189 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.081163 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-xb7wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal","openshift-network-operator/iptables-alerter-pdzjd","openshift-ovn-kubernetes/ovnkube-node-k5bvf","kube-system/global-pull-secret-syncer-xzdgg","kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal","openshift-dns/node-resolver-dg5xf","openshift-multus/multus-additional-cni-plugins-9m64q","openshift-multus/multus-vvwzg","openshift-multus/network-metrics-daemon-tk5wx","openshift-network-diagnostics/network-check-target-4lg7m","kube-system/konnectivity-agent-gpp89","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9","openshift-cluster-node-tuning-operator/tuned-22lp6"] Jul 16 20:32:58.082795 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.082781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.082876 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.082837 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:32:58.084104 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.084085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:58.084187 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.084151 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:32:58.085322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.085303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.086472 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.086454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.086566 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.086484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zhr\" (UniqueName: \"kubernetes.io/projected/e98aa95d-7c60-4bb5-96ea-dc665887bad8-kube-api-access-c8zhr\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.086629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.086579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.087715 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.087694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 20:32:58.087803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.087731 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wrmmq\"" Jul 16 20:32:58.087803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.087731 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 20:32:58.088477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.088460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.089361 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089344 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 20:32:58.089550 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089538 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 20:32:58.089608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.089608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089578 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.089681 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089637 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 20:32:58.089983 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.089967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.090250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090183 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 20:32:58.090412 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2w8n\"" Jul 16 20:32:58.090775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090758 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.090842 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090777 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.090917 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090779 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jngz\"" Jul 16 20:32:58.090917 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.090758 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 20:32:58.091662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.091643 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 20:32:58.091743 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.091697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.092109 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.092095 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 20:32:58.092400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.092382 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.092400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.092397 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.092508 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.092425 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prnz2\"" Jul 16 20:32:58.093392 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.093363 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 20:27:57 +0000 UTC" deadline="2028-02-22 06:38:47.446952603 +0000 UTC" Jul 16 20:32:58.093392 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.093391 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14050h5m49.353565476s" Jul 16 20:32:58.093552 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.093534 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.093614 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.093595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:32:58.093765 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.093751 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 20:32:58.094047 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.094033 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.094136 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.094068 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-djmkv\"" Jul 16 20:32:58.094194 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.094164 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.094322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.094309 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 20:32:58.095238 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.095222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.096565 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.096546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.097262 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.097235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.097946 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.097427 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.097946 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.097665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2frcx\"" Jul 16 20:32:58.098244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.098225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.098601 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.098584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.098812 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.098793 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 20:32:58.098895 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.098823 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-64bd6\"" Jul 16 20:32:58.098895 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.098823 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.099881 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.099862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.100546 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.100521 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 20:32:58.101058 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.101037 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 20:32:58.101499 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.101478 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ck495\"" Jul 16 20:32:58.102279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.102262 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:32:58.102279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.102275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 20:32:58.102607 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.102571 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-df7rt\"" Jul 16 20:32:58.112214 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.112199 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k9gf4" Jul 16 20:32:58.117872 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.117849 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k9gf4" Jul 16 20:32:58.182470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.182446 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 20:32:58.187310 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wlk\" (UniqueName: \"kubernetes.io/projected/a4652bec-5521-4362-851a-8f3e2f354408-kube-api-access-n7wlk\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-host-slash\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-kubernetes\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrsv\" (UniqueName: \"kubernetes.io/projected/ff5edbbb-4f52-4e92-8f70-749bd3026779-kube-api-access-tnrsv\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-systemd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-ovn\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.187437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-netns\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4652bec-5521-4362-851a-8f3e2f354408-tmp-dir\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-iptables-alerter-script\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zhr\" (UniqueName: \"kubernetes.io/projected/e98aa95d-7c60-4bb5-96ea-dc665887bad8-kube-api-access-c8zhr\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-kubelet-config\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.187645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-run\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-var-lib-kubelet\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-host\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-node-log\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-bin\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-bin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-conf-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-daemon-config\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.187851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-modprobe-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lfsj\" (UniqueName: \"kubernetes.io/projected/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-kube-api-access-2lfsj\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-system-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-os-release\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-etc-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.187968 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.187971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.188028 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:58.687999896 +0000 UTC m=+1.946959324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:58.188099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26td5\" (UniqueName: \"kubernetes.io/projected/1134d2da-9d56-4185-89a5-f765178a5abd-kube-api-access-26td5\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-netd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovn-node-metrics-cert\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-system-cni-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysconfig\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-os-release\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cni-binary-copy\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-multus\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4652bec-5521-4362-851a-8f3e2f354408-hosts-file\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-sys\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-tuned\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-tmp\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-netns\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-log-socket\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.188368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-script-lib\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec56db27-8952-4624-9401-4a2d3a6ca985-serviceca\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a456e468-add5-4fce-ab3d-74fdd6b82a9c-agent-certs\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-sys-fs\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-dbus\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-systemd-units\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-var-lib-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-config\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-etc-kubernetes\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjcr\" (UniqueName: \"kubernetes.io/projected/32c67987-edfe-496e-ade9-efc99e4892ab-kube-api-access-kcjcr\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-env-overrides\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a456e468-add5-4fce-ab3d-74fdd6b82a9c-konnectivity-ca\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-device-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cnibin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-conf\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-hostroot\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-registration-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9fz\" (UniqueName: \"kubernetes.io/projected/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-kube-api-access-jq9fz\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-systemd\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-lib-modules\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz75t\" (UniqueName: \"kubernetes.io/projected/ec56db27-8952-4624-9401-4a2d3a6ca985-kube-api-access-kz75t\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.188987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-k8s-cni-cncf-io\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-multus-certs\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-kubelet\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-slash\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.189622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec56db27-8952-4624-9401-4a2d3a6ca985-host\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.190112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-kubelet\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.190112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6p7\" (UniqueName: \"kubernetes.io/projected/bcf70995-ea18-4b18-b314-0719cb7ca5dd-kube-api-access-5p6p7\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.190112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-cnibin\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.190112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-socket-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.190112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.189232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-socket-dir-parent\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.197851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.197830 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 20:32:58.201187 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.201168 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zhr\" (UniqueName: \"kubernetes.io/projected/e98aa95d-7c60-4bb5-96ea-dc665887bad8-kube-api-access-c8zhr\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.213438 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.213411 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd73a2fbeab4f18374893621c83610ee.slice/crio-88bbd7011e2ba38cd2be3485a103b6378dd3890a2034794ea0275de497595148 WatchSource:0}: Error finding container 88bbd7011e2ba38cd2be3485a103b6378dd3890a2034794ea0275de497595148: Status 404 returned error can't find the container with id 88bbd7011e2ba38cd2be3485a103b6378dd3890a2034794ea0275de497595148 Jul 16 20:32:58.214024 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.214010 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1d3d8045e69f5dc2de7b2abaabfdb2.slice/crio-fd4af18e64f0c4dbe48649ae9f0d8758d9ca194048d47015e90efbd99f4f828b WatchSource:0}: Error finding container fd4af18e64f0c4dbe48649ae9f0d8758d9ca194048d47015e90efbd99f4f828b: Status 404 returned error can't find the container with id fd4af18e64f0c4dbe48649ae9f0d8758d9ca194048d47015e90efbd99f4f828b Jul 16 20:32:58.218748 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.218731 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:32:58.258647 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.258600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" event={"ID":"1d1d3d8045e69f5dc2de7b2abaabfdb2","Type":"ContainerStarted","Data":"fd4af18e64f0c4dbe48649ae9f0d8758d9ca194048d47015e90efbd99f4f828b"} Jul 16 20:32:58.259711 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.259692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" event={"ID":"fd73a2fbeab4f18374893621c83610ee","Type":"ContainerStarted","Data":"88bbd7011e2ba38cd2be3485a103b6378dd3890a2034794ea0275de497595148"} Jul 16 20:32:58.289758 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-host-slash\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.289844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-kubernetes\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.289844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrsv\" (UniqueName: \"kubernetes.io/projected/ff5edbbb-4f52-4e92-8f70-749bd3026779-kube-api-access-tnrsv\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.289844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-systemd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.289844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-ovn\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.289844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-netns\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4652bec-5521-4362-851a-8f3e2f354408-tmp-dir\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289857 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-host-slash\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289848 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-kubernetes\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-systemd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-iptables-alerter-script\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-netns\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-ovn\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-kubelet-config\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.289991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-run\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-kubelet-config\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290098 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-run\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-var-lib-kubelet\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-host\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-node-log\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-var-lib-kubelet\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-bin\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290206 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-host\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4652bec-5521-4362-851a-8f3e2f354408-tmp-dir\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290230 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-node-log\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290240 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-bin\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-bin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-conf-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-daemon-config\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-modprobe-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290327 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-bin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lfsj\" (UniqueName: \"kubernetes.io/projected/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-kube-api-access-2lfsj\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290359 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-conf-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-system-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-os-release\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.290784 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-etc-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290430 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-modprobe-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290451 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-iptables-alerter-script\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290473 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-system-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-os-release\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26td5\" (UniqueName: \"kubernetes.io/projected/1134d2da-9d56-4185-89a5-f765178a5abd-kube-api-access-26td5\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-binary-copy\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-netd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290547 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-etc-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovn-node-metrics-cert\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-system-cni-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysconfig\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290620 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-cni-netd\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-os-release\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.291539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-d\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-system-cni-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290680 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysconfig\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-cni-dir\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cni-binary-copy\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-multus\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290734 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-run-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290750 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-os-release\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4652bec-5521-4362-851a-8f3e2f354408-hosts-file\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-cni-multus\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290796 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-daemon-config\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-sys\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290828 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4652bec-5521-4362-851a-8f3e2f354408-hosts-file\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-tuned\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290843 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-sys\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-tmp\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-netns\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.292515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.290981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-log-socket\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-script-lib\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291017 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-netns\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec56db27-8952-4624-9401-4a2d3a6ca985-serviceca\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291058 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a456e468-add5-4fce-ab3d-74fdd6b82a9c-agent-certs\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291074 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-log-socket\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-sys-fs\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-dbus\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-systemd-units\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-var-lib-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291196 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cni-binary-copy\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f77d1b0-90c0-4145-a051-2983b5759704-dbus\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-config\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-var-lib-openvswitch\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-etc-kubernetes\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjcr\" (UniqueName: \"kubernetes.io/projected/32c67987-edfe-496e-ade9-efc99e4892ab-kube-api-access-kcjcr\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-env-overrides\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a456e468-add5-4fce-ab3d-74fdd6b82a9c-konnectivity-ca\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-device-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cnibin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-conf\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-etc-kubernetes\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-hostroot\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-registration-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9fz\" (UniqueName: \"kubernetes.io/projected/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-kube-api-access-jq9fz\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-systemd\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.293984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291834 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-script-lib\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-lib-modules\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291845 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovnkube-config\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz75t\" (UniqueName: \"kubernetes.io/projected/ec56db27-8952-4624-9401-4a2d3a6ca985-kube-api-access-kz75t\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-k8s-cni-cncf-io\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.291957 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291967 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-lib-modules\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-multus-certs\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292005 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec56db27-8952-4624-9401-4a2d3a6ca985-serviceca\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292083 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-k8s-cni-cncf-io\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292100 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-sysctl-conf\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.292115 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:58.792084672 +0000 UTC m=+2.051044099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292147 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-registration-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292166 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-run-multus-certs\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291410 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-sys-fs\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.291313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-systemd-units\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.294495 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-kubelet\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-slash\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-cnibin\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec56db27-8952-4624-9401-4a2d3a6ca985-host\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292189 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-hostroot\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292340 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-systemd\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-kubelet\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292390 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec56db27-8952-4624-9401-4a2d3a6ca985-host\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6p7\" (UniqueName: \"kubernetes.io/projected/bcf70995-ea18-4b18-b314-0719cb7ca5dd-kube-api-access-5p6p7\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-cnibin\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-slash\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-socket-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-host-kubelet\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-socket-dir-parent\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wlk\" (UniqueName: \"kubernetes.io/projected/a4652bec-5521-4362-851a-8f3e2f354408-kube-api-access-n7wlk\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292503 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-device-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.295059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-host-var-lib-kubelet\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1134d2da-9d56-4185-89a5-f765178a5abd-cnibin\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292570 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcf70995-ea18-4b18-b314-0719cb7ca5dd-multus-socket-dir-parent\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292295 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a456e468-add5-4fce-ab3d-74fdd6b82a9c-konnectivity-ca\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32c67987-edfe-496e-ade9-efc99e4892ab-socket-dir\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-env-overrides\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.292844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.293470 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-tmp\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.293818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a456e468-add5-4fce-ab3d-74fdd6b82a9c-agent-certs\") pod \"konnectivity-agent-gpp89\" (UID: \"a456e468-add5-4fce-ab3d-74fdd6b82a9c\") " pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.293920 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1134d2da-9d56-4185-89a5-f765178a5abd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.294324 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-ovn-node-metrics-cert\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.295543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.294574 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff5edbbb-4f52-4e92-8f70-749bd3026779-etc-tuned\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.297107 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.297090 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:32:58.297203 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.297112 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:32:58.297203 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.297132 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:32:58.297203 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.297200 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:58.797183451 +0000 UTC m=+2.056142895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:32:58.299237 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.299191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lfsj\" (UniqueName: \"kubernetes.io/projected/1c4b467b-ce68-46f2-ace2-fb5b9c56a32f-kube-api-access-2lfsj\") pod \"ovnkube-node-k5bvf\" (UID: \"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.300083 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.300053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26td5\" (UniqueName: \"kubernetes.io/projected/1134d2da-9d56-4185-89a5-f765178a5abd-kube-api-access-26td5\") pod \"multus-additional-cni-plugins-9m64q\" (UID: \"1134d2da-9d56-4185-89a5-f765178a5abd\") " pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.300357 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.300331 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrsv\" (UniqueName: \"kubernetes.io/projected/ff5edbbb-4f52-4e92-8f70-749bd3026779-kube-api-access-tnrsv\") pod \"tuned-22lp6\" (UID: \"ff5edbbb-4f52-4e92-8f70-749bd3026779\") " pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.301102 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.301083 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9fz\" (UniqueName: \"kubernetes.io/projected/9f9fc365-da9e-4dd1-9566-6694ffa08e2f-kube-api-access-jq9fz\") pod \"iptables-alerter-pdzjd\" (UID: \"9f9fc365-da9e-4dd1-9566-6694ffa08e2f\") " pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.301240 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.301217 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6p7\" (UniqueName: \"kubernetes.io/projected/bcf70995-ea18-4b18-b314-0719cb7ca5dd-kube-api-access-5p6p7\") pod \"multus-vvwzg\" (UID: \"bcf70995-ea18-4b18-b314-0719cb7ca5dd\") " pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.301240 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.301233 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz75t\" (UniqueName: \"kubernetes.io/projected/ec56db27-8952-4624-9401-4a2d3a6ca985-kube-api-access-kz75t\") pod \"node-ca-xb7wj\" (UID: \"ec56db27-8952-4624-9401-4a2d3a6ca985\") " pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.301734 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.301718 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wlk\" (UniqueName: \"kubernetes.io/projected/a4652bec-5521-4362-851a-8f3e2f354408-kube-api-access-n7wlk\") pod \"node-resolver-dg5xf\" (UID: \"a4652bec-5521-4362-851a-8f3e2f354408\") " pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.301841 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.301824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjcr\" (UniqueName: \"kubernetes.io/projected/32c67987-edfe-496e-ade9-efc99e4892ab-kube-api-access-kcjcr\") pod \"aws-ebs-csi-driver-node-vlpg9\" (UID: \"32c67987-edfe-496e-ade9-efc99e4892ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.403038 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.402983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:32:58.409714 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.409699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:32:58.411307 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.411283 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda456e468_add5_4fce_ab3d_74fdd6b82a9c.slice/crio-1b98058980f80a90da3c9780791240c38bfc8e64029acf2c5ef06d25eeb17d5e WatchSource:0}: Error finding container 1b98058980f80a90da3c9780791240c38bfc8e64029acf2c5ef06d25eeb17d5e: Status 404 returned error can't find the container with id 1b98058980f80a90da3c9780791240c38bfc8e64029acf2c5ef06d25eeb17d5e Jul 16 20:32:58.417583 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.417555 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4b467b_ce68_46f2_ace2_fb5b9c56a32f.slice/crio-5414678c6bd55558c01ed474fcea5940aab9c498e2a4bb065d67b70f0b47a9dd WatchSource:0}: Error finding container 5414678c6bd55558c01ed474fcea5940aab9c498e2a4bb065d67b70f0b47a9dd: Status 404 returned error can't find the container with id 5414678c6bd55558c01ed474fcea5940aab9c498e2a4bb065d67b70f0b47a9dd Jul 16 20:32:58.435887 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.435863 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xb7wj" Jul 16 20:32:58.441439 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.441420 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" Jul 16 20:32:58.443257 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.443233 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec56db27_8952_4624_9401_4a2d3a6ca985.slice/crio-a55d93b63df9c168aefdde9b664f093b6cea0044970d1530200ab0d7222bf180 WatchSource:0}: Error finding container a55d93b63df9c168aefdde9b664f093b6cea0044970d1530200ab0d7222bf180: Status 404 returned error can't find the container with id a55d93b63df9c168aefdde9b664f093b6cea0044970d1530200ab0d7222bf180 Jul 16 20:32:58.448338 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.448312 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c67987_edfe_496e_ade9_efc99e4892ab.slice/crio-b382aecf13fef0868c736b85aa9784927e662937af8ffe8618323cd16f7d05fe WatchSource:0}: Error finding container b382aecf13fef0868c736b85aa9784927e662937af8ffe8618323cd16f7d05fe: Status 404 returned error can't find the container with id b382aecf13fef0868c736b85aa9784927e662937af8ffe8618323cd16f7d05fe Jul 16 20:32:58.451340 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.451323 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:32:58.456019 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.456004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vvwzg" Jul 16 20:32:58.464483 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.464463 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf70995_ea18_4b18_b314_0719cb7ca5dd.slice/crio-2b6445e55a36154257d05be12fb739125caddb10316af74e43f213c9f43e89f1 WatchSource:0}: Error finding container 2b6445e55a36154257d05be12fb739125caddb10316af74e43f213c9f43e89f1: Status 404 returned error can't find the container with id 2b6445e55a36154257d05be12fb739125caddb10316af74e43f213c9f43e89f1 Jul 16 20:32:58.473023 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.473007 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dg5xf" Jul 16 20:32:58.480062 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.480033 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4652bec_5521_4362_851a_8f3e2f354408.slice/crio-57864f47f58155453bb7fd1abeb97f916e74a6df952654fcf0ef65971663d1ce WatchSource:0}: Error finding container 57864f47f58155453bb7fd1abeb97f916e74a6df952654fcf0ef65971663d1ce: Status 404 returned error can't find the container with id 57864f47f58155453bb7fd1abeb97f916e74a6df952654fcf0ef65971663d1ce Jul 16 20:32:58.494968 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.494951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdzjd" Jul 16 20:32:58.501363 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.501341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9fc365_da9e_4dd1_9566_6694ffa08e2f.slice/crio-c666129c627ce54a3476e0f60ee42b410bea08fbde467ee4127156ec8b4c5370 WatchSource:0}: Error finding container c666129c627ce54a3476e0f60ee42b410bea08fbde467ee4127156ec8b4c5370: Status 404 returned error can't find the container with id c666129c627ce54a3476e0f60ee42b410bea08fbde467ee4127156ec8b4c5370 Jul 16 20:32:58.506121 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.506107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9m64q" Jul 16 20:32:58.510807 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.510792 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22lp6" Jul 16 20:32:58.512617 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.512601 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1134d2da_9d56_4185_89a5_f765178a5abd.slice/crio-6712de06c6d9a5f7719c8cc0ad6be4af8fa5af76cfd9c68264985bcfbcfb4e39 WatchSource:0}: Error finding container 6712de06c6d9a5f7719c8cc0ad6be4af8fa5af76cfd9c68264985bcfbcfb4e39: Status 404 returned error can't find the container with id 6712de06c6d9a5f7719c8cc0ad6be4af8fa5af76cfd9c68264985bcfbcfb4e39 Jul 16 20:32:58.517694 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:32:58.517677 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5edbbb_4f52_4e92_8f70_749bd3026779.slice/crio-e7146ea51cf7bb80a2011c6f85083da1c1895bf88dfb50ae51f39a7a365f2033 WatchSource:0}: Error finding container e7146ea51cf7bb80a2011c6f85083da1c1895bf88dfb50ae51f39a7a365f2033: Status 404 returned error can't find the container with id e7146ea51cf7bb80a2011c6f85083da1c1895bf88dfb50ae51f39a7a365f2033 Jul 16 20:32:58.695548 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.695453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:58.695687 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.695637 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:58.695739 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.695694 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:59.695676152 +0000 UTC m=+2.954635585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:58.796340 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.796304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:58.796527 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.796445 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:58.796527 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.796507 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:59.796487348 +0000 UTC m=+3.055446777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:58.897073 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:58.897031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:58.897268 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.897251 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:32:58.897346 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.897277 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:32:58.897346 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.897290 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:32:58.897466 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:58.897349 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:32:59.897328313 +0000 UTC m=+3.156287760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:32:59.119546 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.119403 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 20:27:58 +0000 UTC" deadline="2027-12-31 22:56:47.951002707 +0000 UTC" Jul 16 20:32:59.119546 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.119444 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12794h23m48.831563345s" Jul 16 20:32:59.178149 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.178123 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:32:59.262120 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.262088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:59.262288 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.262230 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:59.262288 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.262226 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:32:59.262416 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.262347 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:32:59.275803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.272367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xb7wj" event={"ID":"ec56db27-8952-4624-9401-4a2d3a6ca985","Type":"ContainerStarted","Data":"a55d93b63df9c168aefdde9b664f093b6cea0044970d1530200ab0d7222bf180"} Jul 16 20:32:59.276536 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.276478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpp89" event={"ID":"a456e468-add5-4fce-ab3d-74fdd6b82a9c","Type":"ContainerStarted","Data":"1b98058980f80a90da3c9780791240c38bfc8e64029acf2c5ef06d25eeb17d5e"} Jul 16 20:32:59.295733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.295700 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerStarted","Data":"6712de06c6d9a5f7719c8cc0ad6be4af8fa5af76cfd9c68264985bcfbcfb4e39"} Jul 16 20:32:59.300652 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.299271 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdzjd" event={"ID":"9f9fc365-da9e-4dd1-9566-6694ffa08e2f","Type":"ContainerStarted","Data":"c666129c627ce54a3476e0f60ee42b410bea08fbde467ee4127156ec8b4c5370"} Jul 16 20:32:59.303205 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.303167 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvwzg" event={"ID":"bcf70995-ea18-4b18-b314-0719cb7ca5dd","Type":"ContainerStarted","Data":"2b6445e55a36154257d05be12fb739125caddb10316af74e43f213c9f43e89f1"} Jul 16 20:32:59.306173 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.306147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" event={"ID":"32c67987-edfe-496e-ade9-efc99e4892ab","Type":"ContainerStarted","Data":"b382aecf13fef0868c736b85aa9784927e662937af8ffe8618323cd16f7d05fe"} Jul 16 20:32:59.314347 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.314322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"5414678c6bd55558c01ed474fcea5940aab9c498e2a4bb065d67b70f0b47a9dd"} Jul 16 20:32:59.324372 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.324341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22lp6" event={"ID":"ff5edbbb-4f52-4e92-8f70-749bd3026779","Type":"ContainerStarted","Data":"e7146ea51cf7bb80a2011c6f85083da1c1895bf88dfb50ae51f39a7a365f2033"} Jul 16 20:32:59.334942 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.334844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dg5xf" event={"ID":"a4652bec-5521-4362-851a-8f3e2f354408","Type":"ContainerStarted","Data":"57864f47f58155453bb7fd1abeb97f916e74a6df952654fcf0ef65971663d1ce"} Jul 16 20:32:59.726223 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.726182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:32:59.726416 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.726352 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:59.726480 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.726421 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:01.726399813 +0000 UTC m=+4.985359260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:32:59.827175 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.827134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:32:59.827365 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.827295 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:59.827365 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.827361 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:01.827341712 +0000 UTC m=+5.086301146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:32:59.928489 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:32:59.928447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:32:59.928712 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.928694 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:32:59.928798 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.928719 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:32:59.928798 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.928733 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:32:59.928798 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:32:59.928792 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:01.928774047 +0000 UTC m=+5.187733491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:00.120752 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:00.120639 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 20:27:58 +0000 UTC" deadline="2028-03-25 17:31:52.809668014 +0000 UTC" Jul 16 20:33:00.120752 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:00.120704 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14828h58m52.688968199s" Jul 16 20:33:00.135823 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:00.135797 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:33:00.254024 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:00.253990 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:00.254194 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:00.254134 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:00.509335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:00.509258 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 20:33:01.257912 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:01.256176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:01.257912 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.256276 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:01.257912 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:01.256603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:01.257912 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.256689 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:01.743595 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:01.743507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:01.743773 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.743699 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:01.743773 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.743761 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:05.743742349 +0000 UTC m=+9.002701783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:01.844873 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:01.844838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:01.845073 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.845004 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:01.845073 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.845066 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:05.845046798 +0000 UTC m=+9.104006240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:01.945736 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:01.945700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:01.945937 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.945911 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:33:01.946007 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.945995 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:33:01.946041 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.946015 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:01.946091 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:01.946081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:05.946060082 +0000 UTC m=+9.205019514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:02.254557 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:02.254528 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:02.254732 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:02.254694 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:03.253999 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:03.253930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:03.253999 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:03.253954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:03.254540 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:03.254071 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:03.254540 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:03.254184 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:04.254179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:04.254135 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:04.254646 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:04.254290 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:05.254726 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:05.254054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:05.254726 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.254191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:05.254726 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:05.254580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:05.254726 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.254661 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:05.781155 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:05.781127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:05.781298 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.781278 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:05.781396 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.781361 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:13.781339743 +0000 UTC m=+17.040299182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:05.882032 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:05.881991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:05.882193 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.882166 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:05.882309 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.882238 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:13.882219952 +0000 UTC m=+17.141179386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:05.983389 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:05.983339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:05.983574 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.983551 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:33:05.983574 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.983573 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:33:05.983691 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.983583 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:05.983691 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:05.983644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:13.983628415 +0000 UTC m=+17.242587846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:06.254751 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:06.254674 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:06.255225 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:06.254825 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:07.254661 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:07.254629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:07.254816 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:07.254709 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:07.255160 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:07.255005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:07.255160 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:07.255150 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:08.254018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:08.253981 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:08.254175 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:08.254113 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:09.254424 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:09.254388 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:09.254862 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:09.254535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:09.254964 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:09.254929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:09.255026 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:09.255005 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:10.254650 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:10.254566 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:10.255028 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:10.254699 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:11.254301 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:11.254267 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:11.254475 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:11.254414 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:11.254475 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:11.254452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:11.254585 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:11.254533 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:12.254528 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:12.254496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:12.254892 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:12.254628 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:13.254507 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:13.254461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:13.254673 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.254593 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:13.254673 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:13.254635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:13.255060 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.254709 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:13.844794 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:13.844715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:13.845016 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.844845 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:13.845016 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.844941 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:29.844918373 +0000 UTC m=+33.103877817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:13.945236 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:13.945199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:13.945408 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.945366 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:13.945460 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:13.945432 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:29.945417859 +0000 UTC m=+33.204377286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:14.045852 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:14.045819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:14.046059 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:14.046027 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:33:14.046059 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:14.046048 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:33:14.046059 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:14.046058 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:14.046219 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:14.046113 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:30.046098209 +0000 UTC m=+33.305057638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:14.254243 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:14.254170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:14.254437 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:14.254312 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:15.253970 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:15.253923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:15.253970 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:15.253967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:15.254517 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:15.254084 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:15.254517 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:15.254218 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:16.253813 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:16.253778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:16.254017 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:16.253918 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:17.254409 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:17.254374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:17.254853 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:17.254456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:17.254853 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:17.254475 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:17.254853 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:17.254544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:18.254286 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:18.254258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:18.254472 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:18.254377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:19.254211 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.253990 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:19.254339 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:19.254214 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:19.254600 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.254580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:19.255020 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:19.254668 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:19.397246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.397213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" event={"ID":"1d1d3d8045e69f5dc2de7b2abaabfdb2","Type":"ContainerStarted","Data":"ee50515ab14c9f4f1b4b740371b242c62163ed2eb0b13cc8372733414b63f4f2"} Jul 16 20:33:19.405745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.405718 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"7e7a118426edc5e39592769ec2c186aff700c9cf0b9c27a1ca7abc33841a9489"} Jul 16 20:33:19.405846 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.405804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"cd4a7fbae8fb56efc88738c968b00cb6df76de2cdd289f148b48ebf699c31f0c"} Jul 16 20:33:19.405935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.405878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"2fe871efdf748a40db27f742f3114835e8b9aab16dad24d2698b849a62881b4b"} Jul 16 20:33:19.405996 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.405961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"7f0788a160720f5004f6f81eff5875e5e2c59a7c8328eba68fa1935e11a2334f"} Jul 16 20:33:19.407582 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.407545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22lp6" event={"ID":"ff5edbbb-4f52-4e92-8f70-749bd3026779","Type":"ContainerStarted","Data":"4dc51a982dbfd35adc437276addec8c14ab7f79909d4c5f8fbb6e7b6626b8c9d"} Jul 16 20:33:19.415636 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:19.415582 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-238.ec2.internal" podStartSLOduration=21.415565886 podStartE2EDuration="21.415565886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:19.415216084 +0000 UTC m=+22.674175534" watchObservedRunningTime="2026-07-16 20:33:19.415565886 +0000 UTC m=+22.674525336" Jul 16 20:33:20.254761 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.254611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:20.255461 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:20.254859 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:20.420699 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.420664 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xb7wj" event={"ID":"ec56db27-8952-4624-9401-4a2d3a6ca985","Type":"ContainerStarted","Data":"92b19a55699022541860ae6c4ba7af2cb97726fab00c26d52c4ac6b7ff443455"} Jul 16 20:33:20.422042 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.422019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpp89" event={"ID":"a456e468-add5-4fce-ab3d-74fdd6b82a9c","Type":"ContainerStarted","Data":"6e3b0fdcbbe9ccc13e6f052ddc1fbbb289a21d414487c2b0425e5f7cf2a589f0"} Jul 16 20:33:20.423378 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.423355 2563 generic.go:356] "Generic (PLEG): container finished" podID="fd73a2fbeab4f18374893621c83610ee" containerID="5a41637f53942b50270788b206ea1bb8ba88dfbd18efc2a4d543e72b482ebf97" exitCode=0 Jul 16 20:33:20.423484 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.423431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" event={"ID":"fd73a2fbeab4f18374893621c83610ee","Type":"ContainerDied","Data":"5a41637f53942b50270788b206ea1bb8ba88dfbd18efc2a4d543e72b482ebf97"} Jul 16 20:33:20.424813 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.424791 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="5fc5ea0fb15ecce74c359223768ff2f786a078b37777708d48a7505e3f7f1429" exitCode=0 Jul 16 20:33:20.424893 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.424849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"5fc5ea0fb15ecce74c359223768ff2f786a078b37777708d48a7505e3f7f1429"} Jul 16 20:33:20.426289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.426260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdzjd" event={"ID":"9f9fc365-da9e-4dd1-9566-6694ffa08e2f","Type":"ContainerStarted","Data":"24c610ad514bd611f8aa249fb6a793049ea6f011569fe01ff3de414b8dee8a58"} Jul 16 20:33:20.427644 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.427618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vvwzg" event={"ID":"bcf70995-ea18-4b18-b314-0719cb7ca5dd","Type":"ContainerStarted","Data":"9155903b8985ccb75080580d44fb7ebeb18deb73730018591cea4fe04dbdd36b"} Jul 16 20:33:20.434228 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.434204 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" event={"ID":"32c67987-edfe-496e-ade9-efc99e4892ab","Type":"ContainerStarted","Data":"197d4beb79a3b9edf0b56c6deb0cad0a0d3d3c0409b27f28962323b933f8d371"} Jul 16 20:33:20.436915 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.436853 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22lp6" podStartSLOduration=2.030620964 podStartE2EDuration="22.436839594s" totalImagesPullingTime="20.40621863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:19.431828111 +0000 UTC m=+22.690787559" watchObservedRunningTime="2026-07-16 20:33:20.436839594 +0000 UTC m=+23.695799043" Jul 16 20:33:20.436995 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.436956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:33:20.437033 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.436999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xb7wj" podStartSLOduration=2.979849171 podStartE2EDuration="23.436989677s" totalImagesPullingTime="20.457140506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:20.436468746 +0000 UTC m=+23.695428194" watchObservedRunningTime="2026-07-16 20:33:20.436989677 +0000 UTC m=+23.695949125" Jul 16 20:33:20.437325 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.437305 2563 generic.go:356] "Generic (PLEG): container finished" podID="1c4b467b-ce68-46f2-ace2-fb5b9c56a32f" containerID="2fe871efdf748a40db27f742f3114835e8b9aab16dad24d2698b849a62881b4b" exitCode=1 Jul 16 20:33:20.437408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.437367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerDied","Data":"2fe871efdf748a40db27f742f3114835e8b9aab16dad24d2698b849a62881b4b"} Jul 16 20:33:20.437460 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.437426 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"468756c63e8089d4f0460b85087a1c0bf59cc35e49f23b7871a6591467bb9e94"} Jul 16 20:33:20.437505 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.437468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"113696e0d383ee48b09b359d603874feb1fa64a0c2116b6bb4b18a51c2f32a24"} Jul 16 20:33:20.438733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.438711 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dg5xf" event={"ID":"a4652bec-5521-4362-851a-8f3e2f354408","Type":"ContainerStarted","Data":"9289bae599eaac967901cb1998994db10359cff86ec0fd01eb867bdc9e7cfeca"} Jul 16 20:33:20.487797 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.487750 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gpp89" podStartSLOduration=3.040099529 podStartE2EDuration="23.487732968s" totalImagesPullingTime="20.447633439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:20.487418364 +0000 UTC m=+23.746377816" watchObservedRunningTime="2026-07-16 20:33:20.487732968 +0000 UTC m=+23.746692417" Jul 16 20:33:20.517427 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.517143 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pdzjd" podStartSLOduration=2.09218035 podStartE2EDuration="22.517126894s" totalImagesPullingTime="20.424946544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:20.516995992 +0000 UTC m=+23.775955440" watchObservedRunningTime="2026-07-16 20:33:20.517126894 +0000 UTC m=+23.776086342" Jul 16 20:33:20.517715 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.517688 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vvwzg" podStartSLOduration=1.565488991 podStartE2EDuration="22.517678526s" totalImagesPullingTime="20.952189535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:20.50396871 +0000 UTC m=+23.762928159" watchObservedRunningTime="2026-07-16 20:33:20.517678526 +0000 UTC m=+23.776637975" Jul 16 20:33:20.528421 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.528392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:20.532199 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.532156 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dg5xf" podStartSLOduration=2.110907927 podStartE2EDuration="22.532145875s" totalImagesPullingTime="20.421237948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:20.531710271 +0000 UTC m=+23.790669718" watchObservedRunningTime="2026-07-16 20:33:20.532145875 +0000 UTC m=+23.791105326" Jul 16 20:33:20.660693 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.660668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:20.761448 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.761417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:20.824132 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.824067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:20.992605 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:20.992584 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 20:33:21.152956 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.152807 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T20:33:20.992598946Z","UUID":"d8842709-1bb6-4a24-ada0-2042f8042a17","Handler":null,"Name":"","Endpoint":""} Jul 16 20:33:21.154795 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.154767 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 20:33:21.154795 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.154796 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 20:33:21.254244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.254213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:21.254401 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.254213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:21.254401 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:21.254345 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:21.254504 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:21.254445 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:21.442458 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.442387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" event={"ID":"32c67987-edfe-496e-ade9-efc99e4892ab","Type":"ContainerStarted","Data":"6a31992a988cc3ca3a0b4e43ab0dfe31c3c9cb6a4f0befe38bd376900078836d"} Jul 16 20:33:21.443990 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.443967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" event={"ID":"fd73a2fbeab4f18374893621c83610ee","Type":"ContainerStarted","Data":"01d9de36d04118fa6cb2f8ca4a04208599f8ac0ab328aec7f742c837719698ba"} Jul 16 20:33:21.460857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.460817 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-238.ec2.internal" podStartSLOduration=23.460806579 podStartE2EDuration="23.460806579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:21.460415278 +0000 UTC m=+24.719374728" watchObservedRunningTime="2026-07-16 20:33:21.460806579 +0000 UTC m=+24.719766029" Jul 16 20:33:21.944477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:21.944440 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:22.044820 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.044741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:22.101476 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.101450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:22.254599 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.254568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:22.254775 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:22.254687 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:22.405261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.405228 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:22.448327 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.448299 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" event={"ID":"32c67987-edfe-496e-ade9-efc99e4892ab","Type":"ContainerStarted","Data":"aa8b52ae4f20fc50726779ea8d7cd584394495a0159a22b2709e0c8542897544"} Jul 16 20:33:22.451714 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.451695 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:33:22.452493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.452470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"a075b655477ff1249153203170a44081a993fbec6ca0f8c35a0295a83e2a5c30"} Jul 16 20:33:22.460583 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.460560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:22.466682 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:22.466639 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vlpg9" podStartSLOduration=7.837360926 podStartE2EDuration="25.466623518s" totalImagesPullingTime="17.629262592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:22.466460448 +0000 UTC m=+25.725419898" watchObservedRunningTime="2026-07-16 20:33:22.466623518 +0000 UTC m=+25.725582968" Jul 16 20:33:23.254599 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:23.254568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:23.254782 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:23.254688 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:23.254782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:23.254727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:23.254929 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:23.254801 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:23.357284 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:23.357252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:23.457673 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:23.457642 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.129091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.129007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.182440 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.182405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.254631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.254604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:24.254955 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:24.254920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:24.594401 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.594324 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:33:24.595196 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.595175 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:33:24.679647 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.679605 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.792497 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.792462 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.849790 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.849724 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:24.969876 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:24.969846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:25.033706 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.033670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:25.254730 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.254583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:25.254853 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.254655 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:25.257047 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:25.255676 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:25.257047 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:25.256582 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:25.451820 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.451777 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:25.461569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.461543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:33:25.462076 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.462043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"666a99fdf6dd577709a753395414de9bb0ce380c3d651f2e40579ce18b3e3abb"} Jul 16 20:33:25.462341 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.462323 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:25.462530 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.462508 2563 scope.go:117] "RemoveContainer" containerID="2fe871efdf748a40db27f742f3114835e8b9aab16dad24d2698b849a62881b4b" Jul 16 20:33:25.464810 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.464783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerStarted","Data":"2e57998b5e3c8481e816e517fb4245ff63741c8d3b75548aeee92061fa937023"} Jul 16 20:33:25.479735 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.479710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:25.518712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:25.518688 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:26.253754 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.253726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:26.254414 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:26.253812 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:26.469568 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.469507 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:33:26.469860 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.469831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" event={"ID":"1c4b467b-ce68-46f2-ace2-fb5b9c56a32f","Type":"ContainerStarted","Data":"d4a7dc828719f03110186922b84a174c0c3f68078d2e216e59fd41dfc4481b64"} Jul 16 20:33:26.470174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.469993 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:26.470174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.470035 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:26.471732 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.471711 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="2e57998b5e3c8481e816e517fb4245ff63741c8d3b75548aeee92061fa937023" exitCode=0 Jul 16 20:33:26.471828 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.471750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"2e57998b5e3c8481e816e517fb4245ff63741c8d3b75548aeee92061fa937023"} Jul 16 20:33:26.486074 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.486054 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:26.499546 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:26.499502 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" podStartSLOduration=8.94475427 podStartE2EDuration="29.499489455s" totalImagesPullingTime="20.554735185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:26.498000231 +0000 UTC m=+29.756959679" watchObservedRunningTime="2026-07-16 20:33:26.499489455 +0000 UTC m=+29.758448901" Jul 16 20:33:27.146283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.146106 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:27.246614 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.246587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:27.249489 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.249469 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:33:27.249587 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.249579 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 20:33:27.249997 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.249979 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gpp89" Jul 16 20:33:27.253650 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.253631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:27.253776 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:27.253749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:27.254167 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.254039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:27.254167 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:27.254124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:27.294321 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.294292 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzdgg"] Jul 16 20:33:27.294461 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.294444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:27.294576 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:27.294553 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:27.294959 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.294938 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tk5wx"] Jul 16 20:33:27.295712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.295689 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4lg7m"] Jul 16 20:33:27.331949 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.331927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dg5xf_a4652bec-5521-4362-851a-8f3e2f354408/dns-node-resolver/0.log" Jul 16 20:33:27.347087 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.347053 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:27.476074 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.476044 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="ad86fb6c69e5879d17d5dc82d256eb8f03679a40060e9d958793a46003a0f8da" exitCode=0 Jul 16 20:33:27.476260 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.476160 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"ad86fb6c69e5879d17d5dc82d256eb8f03679a40060e9d958793a46003a0f8da"} Jul 16 20:33:27.476260 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.476195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:27.476400 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:27.476378 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:27.476480 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.476465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:27.476597 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:27.476560 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:27.951598 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:27.951569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:28.330358 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:28.330291 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xb7wj_ec56db27-8952-4624-9401-4a2d3a6ca985/node-ca/0.log" Jul 16 20:33:29.254295 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:29.254269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:29.254451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:29.254270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:29.254451 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.254368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:29.254451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:29.254275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:29.254550 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.254446 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:29.254550 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.254511 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:29.863770 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:29.863691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:29.864138 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.863840 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:29.864138 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.863921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs podName:e98aa95d-7c60-4bb5-96ea-dc665887bad8 nodeName:}" failed. No retries permitted until 2026-07-16 20:34:01.863883055 +0000 UTC m=+65.122842482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs") pod "network-metrics-daemon-tk5wx" (UID: "e98aa95d-7c60-4bb5-96ea-dc665887bad8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 20:33:29.964763 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:29.964715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:29.964984 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.964843 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:29.964984 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:29.964931 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret podName:2f77d1b0-90c0-4145-a051-2983b5759704 nodeName:}" failed. No retries permitted until 2026-07-16 20:34:01.964894069 +0000 UTC m=+65.223853503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret") pod "global-pull-secret-syncer-xzdgg" (UID: "2f77d1b0-90c0-4145-a051-2983b5759704") : object "kube-system"/"original-pull-secret" not registered Jul 16 20:33:30.065206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:30.065162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:30.065345 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:30.065317 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 20:33:30.065345 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:30.065334 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 20:33:30.065345 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:30.065343 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fdb9r for pod openshift-network-diagnostics/network-check-target-4lg7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:30.065438 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:30.065395 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r podName:998e2b66-5eb3-4e01-8d8a-b71da0530af5 nodeName:}" failed. No retries permitted until 2026-07-16 20:34:02.065382209 +0000 UTC m=+65.324341636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdb9r" (UniqueName: "kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r") pod "network-check-target-4lg7m" (UID: "998e2b66-5eb3-4e01-8d8a-b71da0530af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 20:33:30.795222 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:30.795186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.019065 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.018986 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.141385 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.141325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.246287 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.246263 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.254459 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.254443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:31.254525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.254458 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:31.254566 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:31.254546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:31.254623 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:31.254590 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:31.254677 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.254621 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:31.254737 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:31.254716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:31.350548 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.350493 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.447624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.447598 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.486054 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.486031 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="646ef7d84bab3684c70067510c92d2b46146b3a101335fc4cd8b77b3c127d8f2" exitCode=0 Jul 16 20:33:31.486143 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.486080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"646ef7d84bab3684c70067510c92d2b46146b3a101335fc4cd8b77b3c127d8f2"} Jul 16 20:33:31.531898 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.531877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:31.744743 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:31.744708 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:32.519640 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:32.519611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:32.750330 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:32.750298 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:32.919276 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:32.919231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:33.253985 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:33.253914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:33.253985 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:33.253928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:33.254158 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:33.253916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:33.254158 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:33.254013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:33.254158 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:33.254090 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:33.254158 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:33.254142 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:33.914664 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:33.914625 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:34.153832 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:34.153805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:34.316819 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:34.316729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:34.520474 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:34.520447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:34.716543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:34.716339 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:34.771854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:34.771823 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:35.121594 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.121519 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:35.175276 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.175252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:35.254177 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.254145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:35.254350 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:35.254263 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:35.254350 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.254269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:35.254350 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.254148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:35.254527 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:35.254369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:35.254527 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:35.254445 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:35.724263 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.724231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:35.774291 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:35.774252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:36.122927 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:36.122826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:36.519911 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:36.519883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:36.718853 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:36.718824 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.006149 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.006110 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.108210 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.108095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.255676 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.255648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:37.256221 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.255728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:37.256315 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.255805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:37.256380 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:37.256336 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:37.256470 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:37.256447 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:37.256470 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:37.256463 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:37.319486 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.319458 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.421262 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.421234 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.811176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.811067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:37.920043 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:37.919998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:38.128767 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:38.128679 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:38.323839 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:38.323807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:38.725922 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:38.725875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:39.121849 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:39.121779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:39.254225 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:39.254190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:39.254225 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:39.254213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:39.254432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:39.254221 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:39.254432 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:39.254289 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:39.254432 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:39.254371 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:39.254591 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:39.254474 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:39.729491 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:39.729423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:40.120443 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:40.120368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:40.507858 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:40.507827 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="e3b48452c0701f8503ea47fe5f3249a7e5e28ca81976aab778b870540ba868d9" exitCode=0 Jul 16 20:33:40.507858 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:40.507862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"e3b48452c0701f8503ea47fe5f3249a7e5e28ca81976aab778b870540ba868d9"} Jul 16 20:33:40.520105 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:40.520083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:40.722032 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:40.721998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:41.130456 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.130418 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:41.254035 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.254002 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:41.254178 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.254044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:41.254178 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.254004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:41.254178 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:41.254111 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:41.254295 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:41.254173 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:41.254295 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:41.254260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:41.513552 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.513520 2563 generic.go:356] "Generic (PLEG): container finished" podID="1134d2da-9d56-4185-89a5-f765178a5abd" containerID="dd32eb0ddb2e72ce493fb15da0b7d50f0c128e63cbd5bd53a1666f2a98e31352" exitCode=0 Jul 16 20:33:41.513727 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.513562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerDied","Data":"dd32eb0ddb2e72ce493fb15da0b7d50f0c128e63cbd5bd53a1666f2a98e31352"} Jul 16 20:33:41.522428 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.522406 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:41.714781 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:41.714753 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:42.478763 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.478730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:42.518785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.518755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9m64q" event={"ID":"1134d2da-9d56-4185-89a5-f765178a5abd","Type":"ContainerStarted","Data":"038ecba9f45ef911a09b30680bed88bcc27801257e5537e3cc46f4ef286f5edf"} Jul 16 20:33:42.541611 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.541573 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9m64q" podStartSLOduration=7.276272808 podStartE2EDuration="44.541561007s" totalImagesPullingTime="37.265288199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:42.54120062 +0000 UTC m=+45.800160070" watchObservedRunningTime="2026-07-16 20:33:42.541561007 +0000 UTC m=+45.800520464" Jul 16 20:33:42.572745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.572719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:42.789764 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.789667 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:42.954146 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:42.954114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:43.153766 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.153735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:43.212381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.212340 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:43.254499 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.254473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:43.254499 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.254489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:43.254632 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:43.254574 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:43.254676 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:43.254657 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:43.254714 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.254686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:43.254849 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:43.254831 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:43.563211 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.563126 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:43.614144 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:43.614110 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:44.165744 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:44.165710 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:44.362522 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:44.362488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:44.569876 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:44.569805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:45.254609 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.254580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:45.254609 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.254610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:45.254871 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:45.254710 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tk5wx" podUID="e98aa95d-7c60-4bb5-96ea-dc665887bad8" Jul 16 20:33:45.254871 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:45.254744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4lg7m" podUID="998e2b66-5eb3-4e01-8d8a-b71da0530af5" Jul 16 20:33:45.254871 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.254771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:45.254871 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:45.254837 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzdgg" podUID="2f77d1b0-90c0-4145-a051-2983b5759704" Jul 16 20:33:45.388713 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.388684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:45.607744 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.607673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:45.708421 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:45.708387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.086441 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:46.086410 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.190838 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:46.190810 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.295382 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:46.295352 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:46.388140 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:46.388121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:47.044817 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.044793 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-238.ec2.internal" event="NodeReady" Jul 16 20:33:47.045200 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.044925 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 20:33:47.128386 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.128330 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s6pj4"] Jul 16 20:33:47.144795 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.144774 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4xgw6"] Jul 16 20:33:47.144958 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.144882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.147922 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.147880 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xlvk5\"" Jul 16 20:33:47.150116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.150090 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 20:33:47.150222 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.150204 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 20:33:47.158582 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.158565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6pj4"] Jul 16 20:33:47.158674 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.158595 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xgw6"] Jul 16 20:33:47.158674 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.158654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.162534 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.162515 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dt299\"" Jul 16 20:33:47.162646 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.162629 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 20:33:47.162773 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.162754 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 20:33:47.163341 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.163320 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 20:33:47.170360 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.170342 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-697ss"] Jul 16 20:33:47.187664 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.187637 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-697ss"] Jul 16 20:33:47.187760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.187722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.192298 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192280 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 20:33:47.192439 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192422 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 20:33:47.192516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa1eaf07-f6a7-4726-b783-231729af68ae-config-volume\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.192516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 20:33:47.192516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xmq\" (UniqueName: \"kubernetes.io/projected/7ba723ad-a6de-4209-a4fa-ca7492999cc4-kube-api-access-m2xmq\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.192516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192483 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-khzsm\"" Jul 16 20:33:47.192698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa1eaf07-f6a7-4726-b783-231729af68ae-tmp-dir\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.192698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87kn\" (UniqueName: \"kubernetes.io/projected/fa1eaf07-f6a7-4726-b783-231729af68ae-kube-api-access-g87kn\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.192698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1eaf07-f6a7-4726-b783-231729af68ae-metrics-tls\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.192698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 20:33:47.192698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.192643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ba723ad-a6de-4209-a4fa-ca7492999cc4-cert\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.256743 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.256724 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:33:47.256845 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.256816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:33:47.256897 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.256841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:33:47.259870 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.259856 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 20:33:47.260178 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.260163 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ql74g\"" Jul 16 20:33:47.261144 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.261125 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 20:33:47.261144 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.261127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjwwv\"" Jul 16 20:33:47.261374 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.261361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 20:33:47.261438 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.261382 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 20:33:47.292866 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.292842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87kn\" (UniqueName: \"kubernetes.io/projected/fa1eaf07-f6a7-4726-b783-231729af68ae-kube-api-access-g87kn\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.292957 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.292879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1eaf07-f6a7-4726-b783-231729af68ae-metrics-tls\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.293050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ba723ad-a6de-4209-a4fa-ca7492999cc4-cert\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.293102 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45b26552-8266-4349-9d2a-ed154157feeb-crio-socket\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.293102 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45b26552-8266-4349-9d2a-ed154157feeb-data-volume\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.293186 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45b26552-8266-4349-9d2a-ed154157feeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.293186 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45b26552-8266-4349-9d2a-ed154157feeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.293281 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa1eaf07-f6a7-4726-b783-231729af68ae-config-volume\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.293281 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xmq\" (UniqueName: \"kubernetes.io/projected/7ba723ad-a6de-4209-a4fa-ca7492999cc4-kube-api-access-m2xmq\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.293281 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq4wc\" (UniqueName: \"kubernetes.io/projected/45b26552-8266-4349-9d2a-ed154157feeb-kube-api-access-tq4wc\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.293428 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa1eaf07-f6a7-4726-b783-231729af68ae-tmp-dir\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.293577 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa1eaf07-f6a7-4726-b783-231729af68ae-tmp-dir\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.293733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.293716 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa1eaf07-f6a7-4726-b783-231729af68ae-config-volume\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.296704 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.296683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1eaf07-f6a7-4726-b783-231729af68ae-metrics-tls\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.296844 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.296823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ba723ad-a6de-4209-a4fa-ca7492999cc4-cert\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.301613 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.301586 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xmq\" (UniqueName: \"kubernetes.io/projected/7ba723ad-a6de-4209-a4fa-ca7492999cc4-kube-api-access-m2xmq\") pod \"ingress-canary-4xgw6\" (UID: \"7ba723ad-a6de-4209-a4fa-ca7492999cc4\") " pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.301800 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.301782 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87kn\" (UniqueName: \"kubernetes.io/projected/fa1eaf07-f6a7-4726-b783-231729af68ae-kube-api-access-g87kn\") pod \"dns-default-s6pj4\" (UID: \"fa1eaf07-f6a7-4726-b783-231729af68ae\") " pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.312492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.312462 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:47.376060 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.376028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:47.394131 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45b26552-8266-4349-9d2a-ed154157feeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394239 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45b26552-8266-4349-9d2a-ed154157feeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394239 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq4wc\" (UniqueName: \"kubernetes.io/projected/45b26552-8266-4349-9d2a-ed154157feeb-kube-api-access-tq4wc\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394348 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45b26552-8266-4349-9d2a-ed154157feeb-crio-socket\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394348 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45b26552-8266-4349-9d2a-ed154157feeb-data-volume\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394487 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45b26552-8266-4349-9d2a-ed154157feeb-crio-socket\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394611 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45b26552-8266-4349-9d2a-ed154157feeb-data-volume\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.394680 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.394641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45b26552-8266-4349-9d2a-ed154157feeb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.396611 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.396594 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45b26552-8266-4349-9d2a-ed154157feeb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.402071 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.402053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq4wc\" (UniqueName: \"kubernetes.io/projected/45b26552-8266-4349-9d2a-ed154157feeb-kube-api-access-tq4wc\") pod \"insights-runtime-extractor-697ss\" (UID: \"45b26552-8266-4349-9d2a-ed154157feeb\") " pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.456014 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.455993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:47.466109 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.466092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xgw6" Jul 16 20:33:47.496992 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.496975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-697ss" Jul 16 20:33:47.673945 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.673897 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s6pj4"] Jul 16 20:33:47.677321 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:47.677293 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1eaf07_f6a7_4726_b783_231729af68ae.slice/crio-5705676c980ffced29196e004a3660610065c79bbf102ae91b3a333cfa84432b WatchSource:0}: Error finding container 5705676c980ffced29196e004a3660610065c79bbf102ae91b3a333cfa84432b: Status 404 returned error can't find the container with id 5705676c980ffced29196e004a3660610065c79bbf102ae91b3a333cfa84432b Jul 16 20:33:47.685056 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.685027 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xgw6"] Jul 16 20:33:47.687559 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:47.687540 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba723ad_a6de_4209_a4fa_ca7492999cc4.slice/crio-060831a278cc81a1fa36ca21325f87857086a95c47e3b85952760ad9c7d58d17 WatchSource:0}: Error finding container 060831a278cc81a1fa36ca21325f87857086a95c47e3b85952760ad9c7d58d17: Status 404 returned error can't find the container with id 060831a278cc81a1fa36ca21325f87857086a95c47e3b85952760ad9c7d58d17 Jul 16 20:33:47.701398 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:47.701376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-697ss"] Jul 16 20:33:47.704403 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:47.704380 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b26552_8266_4349_9d2a_ed154157feeb.slice/crio-55dfdace3300efdc421ece367a943dfd0dc2efd019e74d5ae93bb3055aaaf366 WatchSource:0}: Error finding container 55dfdace3300efdc421ece367a943dfd0dc2efd019e74d5ae93bb3055aaaf366: Status 404 returned error can't find the container with id 55dfdace3300efdc421ece367a943dfd0dc2efd019e74d5ae93bb3055aaaf366 Jul 16 20:33:48.536220 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:48.536136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xgw6" event={"ID":"7ba723ad-a6de-4209-a4fa-ca7492999cc4","Type":"ContainerStarted","Data":"060831a278cc81a1fa36ca21325f87857086a95c47e3b85952760ad9c7d58d17"} Jul 16 20:33:48.538633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:48.538584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6pj4" event={"ID":"fa1eaf07-f6a7-4726-b783-231729af68ae","Type":"ContainerStarted","Data":"5705676c980ffced29196e004a3660610065c79bbf102ae91b3a333cfa84432b"} Jul 16 20:33:48.540450 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:48.540421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-697ss" event={"ID":"45b26552-8266-4349-9d2a-ed154157feeb","Type":"ContainerStarted","Data":"55dfdace3300efdc421ece367a943dfd0dc2efd019e74d5ae93bb3055aaaf366"} Jul 16 20:33:53.095945 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.095856 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.197808 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.197768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.292520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.292483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.315704 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.315677 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g"] Jul 16 20:33:53.317994 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.317959 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:53.324703 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.324675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 20:33:53.325881 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.324994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lnvwr\"" Jul 16 20:33:53.329067 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.329044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g"] Jul 16 20:33:53.364760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.364695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.441009 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.440978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5q47g\" (UID: \"c99158e7-e04e-4e26-a719-da9475e7ba57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:53.541324 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.541299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5q47g\" (UID: \"c99158e7-e04e-4e26-a719-da9475e7ba57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:53.541448 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:53.541430 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 16 20:33:53.541507 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:53.541493 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates podName:c99158e7-e04e-4e26-a719-da9475e7ba57 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:54.041478836 +0000 UTC m=+57.300438264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-5q47g" (UID: "c99158e7-e04e-4e26-a719-da9475e7ba57") : secret "prometheus-operator-admission-webhook-tls" not found Jul 16 20:33:53.556360 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.556330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xgw6" event={"ID":"7ba723ad-a6de-4209-a4fa-ca7492999cc4","Type":"ContainerStarted","Data":"3b0965b863150577be20e516ed069025210484c831918d696a6c0bcb513786f1"} Jul 16 20:33:53.575867 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.575294 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4xgw6" podStartSLOduration=0.807641492 podStartE2EDuration="6.575274998s" totalImagesPullingTime="5.767633506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:53.574302583 +0000 UTC m=+56.833262033" watchObservedRunningTime="2026-07-16 20:33:53.575274998 +0000 UTC m=+56.834234445" Jul 16 20:33:53.604188 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.604121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.613117 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.612914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:33:53.615942 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.615151 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.617617 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.617471 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 20:33:53.617757 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.617724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.617937 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.618154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.618178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.618339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qdlh5\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.618429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 20:33:53.618695 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.618535 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 20:33:53.627246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.627216 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:33:53.665542 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.665509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:53.742477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.742638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.742638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.742638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzzt7\" (UniqueName: \"kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.742763 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.742763 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.742683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzzt7\" (UniqueName: \"kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.843854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.843771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.844453 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.844429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.844566 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.844490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.844664 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.844642 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.846365 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.846345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.846414 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.846353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.852595 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.852575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzzt7\" (UniqueName: \"kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7\") pod \"console-85bb959744-ws7r6\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:53.928954 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:53.928928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:33:54.045649 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.045605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5q47g\" (UID: \"c99158e7-e04e-4e26-a719-da9475e7ba57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:54.049462 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.049432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c99158e7-e04e-4e26-a719-da9475e7ba57-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5q47g\" (UID: \"c99158e7-e04e-4e26-a719-da9475e7ba57\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:54.064793 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.064767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:33:54.069129 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:54.069104 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba1722d_9680_4dd6_acd7_eea9d4952563.slice/crio-aa8ba6e0afd94dea181a55ecefbcfee03d33302a083c780ed55f31ce597fc281 WatchSource:0}: Error finding container aa8ba6e0afd94dea181a55ecefbcfee03d33302a083c780ed55f31ce597fc281: Status 404 returned error can't find the container with id aa8ba6e0afd94dea181a55ecefbcfee03d33302a083c780ed55f31ce597fc281 Jul 16 20:33:54.234895 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.234821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:54.369498 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.369463 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g"] Jul 16 20:33:54.373081 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:54.373056 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99158e7_e04e_4e26_a719_da9475e7ba57.slice/crio-7249832bd987ad37f070ff671343ec890edd364418820474a79ef4f2af881b54 WatchSource:0}: Error finding container 7249832bd987ad37f070ff671343ec890edd364418820474a79ef4f2af881b54: Status 404 returned error can't find the container with id 7249832bd987ad37f070ff671343ec890edd364418820474a79ef4f2af881b54 Jul 16 20:33:54.560010 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.559946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-697ss" event={"ID":"45b26552-8266-4349-9d2a-ed154157feeb","Type":"ContainerStarted","Data":"34d75b027d3ef7aa0ff9b7042def2f3b7995e7e90f08fdb168b746b17d61bc86"} Jul 16 20:33:54.561098 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.561072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" event={"ID":"c99158e7-e04e-4e26-a719-da9475e7ba57","Type":"ContainerStarted","Data":"7249832bd987ad37f070ff671343ec890edd364418820474a79ef4f2af881b54"} Jul 16 20:33:54.562754 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.562730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6pj4" event={"ID":"fa1eaf07-f6a7-4726-b783-231729af68ae","Type":"ContainerStarted","Data":"bc12da3886c9f01c8898ae5e2720f2d4256dbf11116f8f5022e3a5055d2c4bdb"} Jul 16 20:33:54.562944 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.562770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s6pj4" event={"ID":"fa1eaf07-f6a7-4726-b783-231729af68ae","Type":"ContainerStarted","Data":"df5c19fc55b1f16a901a3693c199c2c11ccc9aa78811572b5da8612072936a84"} Jul 16 20:33:54.562944 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.562894 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s6pj4" Jul 16 20:33:54.563863 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.563839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb959744-ws7r6" event={"ID":"cba1722d-9680-4dd6-acd7-eea9d4952563","Type":"ContainerStarted","Data":"aa8ba6e0afd94dea181a55ecefbcfee03d33302a083c780ed55f31ce597fc281"} Jul 16 20:33:54.580002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:54.579961 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s6pj4" podStartSLOduration=1.801819125 podStartE2EDuration="7.579947415s" totalImagesPullingTime="5.77812829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:54.578476099 +0000 UTC m=+57.837435547" watchObservedRunningTime="2026-07-16 20:33:54.579947415 +0000 UTC m=+57.838906841" Jul 16 20:33:55.990047 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:55.990018 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:33:55.996441 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:55.996409 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:56.010651 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.010627 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.010651 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.010549 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:33:56.018380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.018339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 20:33:56.050915 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.050875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:56.060492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060642 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060642 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtgr\" (UniqueName: \"kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060642 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060642 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.060851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.060673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161055 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161055 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgtgr\" (UniqueName: \"kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.161269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.161216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.162372 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.162344 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.162539 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.162438 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.162625 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.162605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.163109 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.163065 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.164456 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.164425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.164847 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.164824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.170885 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.170866 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgtgr\" (UniqueName: \"kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr\") pod \"console-5c865f457d-ghv8r\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.321892 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.321851 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:33:56.479651 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.479614 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:33:56.573641 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.573608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" event={"ID":"c99158e7-e04e-4e26-a719-da9475e7ba57","Type":"ContainerStarted","Data":"1718031417ee7feec5dc2fc47f5734a9294cc149c90630b20b12922280d4fb4c"} Jul 16 20:33:56.574033 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.573957 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:56.580467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.580442 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" Jul 16 20:33:56.596469 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:56.596094 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5q47g" podStartSLOduration=2.123862663 podStartE2EDuration="3.596076803s" totalImagesPullingTime="1.47221414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:33:56.59526699 +0000 UTC m=+59.854226438" watchObservedRunningTime="2026-07-16 20:33:56.596076803 +0000 UTC m=+59.855036253" Jul 16 20:33:57.038257 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.038229 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:57.159788 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.159758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:57.252638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.252593 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:57.381067 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.380995 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:57.473503 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.473474 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw"] Jul 16 20:33:57.479038 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.479015 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.486711 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.486688 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 20:33:57.487769 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.487748 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 20:33:57.488200 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.488178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8k7n4\"" Jul 16 20:33:57.488937 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.488894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 20:33:57.489029 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.488999 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 20:33:57.501945 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.501925 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 20:33:57.510041 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.510019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw"] Jul 16 20:33:57.520739 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.520710 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:57.573252 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.573222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.573384 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.573265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec22871-595b-45b6-be9f-8d008a097585-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.573384 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.573361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.573570 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.573411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprqh\" (UniqueName: \"kubernetes.io/projected/7ec22871-595b-45b6-be9f-8d008a097585-kube-api-access-rprqh\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.582383 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:57.582359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cad81ea_8dcc_42d0_9acc_350d834708bf.slice/crio-31e519f864ad8d7ec1d9a1c56065661f7bb4033e30051f543e4d490d076cd647 WatchSource:0}: Error finding container 31e519f864ad8d7ec1d9a1c56065661f7bb4033e30051f543e4d490d076cd647: Status 404 returned error can't find the container with id 31e519f864ad8d7ec1d9a1c56065661f7bb4033e30051f543e4d490d076cd647 Jul 16 20:33:57.674022 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.673985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.674204 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.674033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec22871-595b-45b6-be9f-8d008a097585-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.674204 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.674099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.674204 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:57.674117 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 20:33:57.674204 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.674173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rprqh\" (UniqueName: \"kubernetes.io/projected/7ec22871-595b-45b6-be9f-8d008a097585-kube-api-access-rprqh\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.674204 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:33:57.674192 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls podName:7ec22871-595b-45b6-be9f-8d008a097585 nodeName:}" failed. No retries permitted until 2026-07-16 20:33:58.174173911 +0000 UTC m=+61.433133354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-8m4cw" (UID: "7ec22871-595b-45b6-be9f-8d008a097585") : secret "prometheus-operator-tls" not found Jul 16 20:33:57.674762 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.674740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ec22871-595b-45b6-be9f-8d008a097585-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.676926 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.676885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.685569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.685547 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprqh\" (UniqueName: \"kubernetes.io/projected/7ec22871-595b-45b6-be9f-8d008a097585-kube-api-access-rprqh\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:57.805184 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:57.805153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:58.178361 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.178319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:58.181300 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.181269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ec22871-595b-45b6-be9f-8d008a097585-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8m4cw\" (UID: \"7ec22871-595b-45b6-be9f-8d008a097585\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:58.388927 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.388880 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" Jul 16 20:33:58.489562 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.489484 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5bvf" Jul 16 20:33:58.581513 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.581471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c865f457d-ghv8r" event={"ID":"6cad81ea-8dcc-42d0-9acc-350d834708bf","Type":"ContainerStarted","Data":"31e519f864ad8d7ec1d9a1c56065661f7bb4033e30051f543e4d490d076cd647"} Jul 16 20:33:58.627313 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.627270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:58.731098 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:58.731060 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:59.620628 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:59.620598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw"] Jul 16 20:33:59.625295 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:33:59.625269 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec22871_595b_45b6_be9f_8d008a097585.slice/crio-92e2af3fab8a368e6f5f38e61a00796fcd60991faea34eeeb04d866c1618639b WatchSource:0}: Error finding container 92e2af3fab8a368e6f5f38e61a00796fcd60991faea34eeeb04d866c1618639b: Status 404 returned error can't find the container with id 92e2af3fab8a368e6f5f38e61a00796fcd60991faea34eeeb04d866c1618639b Jul 16 20:33:59.809294 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:59.809213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:33:59.909111 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:33:59.909077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:00.599769 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.599702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c865f457d-ghv8r" event={"ID":"6cad81ea-8dcc-42d0-9acc-350d834708bf","Type":"ContainerStarted","Data":"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512"} Jul 16 20:34:00.601222 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.601195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" event={"ID":"7ec22871-595b-45b6-be9f-8d008a097585","Type":"ContainerStarted","Data":"92e2af3fab8a368e6f5f38e61a00796fcd60991faea34eeeb04d866c1618639b"} Jul 16 20:34:00.603022 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.602992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb959744-ws7r6" event={"ID":"cba1722d-9680-4dd6-acd7-eea9d4952563","Type":"ContainerStarted","Data":"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45"} Jul 16 20:34:00.605221 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.605193 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:00.606554 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.606535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-697ss" event={"ID":"45b26552-8266-4349-9d2a-ed154157feeb","Type":"ContainerStarted","Data":"eabb58278eeb22228f470fa47b106576f95079dcd138a14a445bfde8cda35498"} Jul 16 20:34:00.620367 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.620322 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c865f457d-ghv8r" podStartSLOduration=3.686761718 podStartE2EDuration="5.620306055s" totalImagesPullingTime="1.933544337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:00.619834724 +0000 UTC m=+63.878794177" watchObservedRunningTime="2026-07-16 20:34:00.620306055 +0000 UTC m=+63.879265502" Jul 16 20:34:00.654170 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.654115 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85bb959744-ws7r6" podStartSLOduration=2.251292556 podStartE2EDuration="7.65409372s" totalImagesPullingTime="5.402801164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:00.65335129 +0000 UTC m=+63.912310740" watchObservedRunningTime="2026-07-16 20:34:00.65409372 +0000 UTC m=+63.913053166" Jul 16 20:34:00.712062 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:00.712025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:01.444332 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.444299 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:01.611620 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.611582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" event={"ID":"7ec22871-595b-45b6-be9f-8d008a097585","Type":"ContainerStarted","Data":"9d5826c7eb87d10fedec43bf0942d047eac3ceb24391dc5ed135948d51e703d7"} Jul 16 20:34:01.611786 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.611633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" event={"ID":"7ec22871-595b-45b6-be9f-8d008a097585","Type":"ContainerStarted","Data":"c1b41ca5ce50624b52d673b95f1c3b218ccfca601034d297bd54e5fa721095bb"} Jul 16 20:34:01.633449 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.632663 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8m4cw" podStartSLOduration=3.14354897 podStartE2EDuration="4.632646196s" totalImagesPullingTime="1.489097226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:01.631045322 +0000 UTC m=+64.890004771" watchObservedRunningTime="2026-07-16 20:34:01.632646196 +0000 UTC m=+64.891605646" Jul 16 20:34:01.912846 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.912813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:34:01.915728 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.915708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 20:34:01.925572 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.925553 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e98aa95d-7c60-4bb5-96ea-dc665887bad8-metrics-certs\") pod \"network-metrics-daemon-tk5wx\" (UID: \"e98aa95d-7c60-4bb5-96ea-dc665887bad8\") " pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:34:01.975001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.974967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ql74g\"" Jul 16 20:34:01.976986 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:01.976965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tk5wx" Jul 16 20:34:02.013305 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.013259 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:34:02.016604 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.016581 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 20:34:02.026878 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.026692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f77d1b0-90c0-4145-a051-2983b5759704-original-pull-secret\") pod \"global-pull-secret-syncer-xzdgg\" (UID: \"2f77d1b0-90c0-4145-a051-2983b5759704\") " pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:34:02.114033 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.114004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:34:02.116755 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.116725 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 20:34:02.128493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.128472 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 20:34:02.138554 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.138500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdb9r\" (UniqueName: \"kubernetes.io/projected/998e2b66-5eb3-4e01-8d8a-b71da0530af5-kube-api-access-fdb9r\") pod \"network-check-target-4lg7m\" (UID: \"998e2b66-5eb3-4e01-8d8a-b71da0530af5\") " pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:34:02.168244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.168167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:02.270392 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.270361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:02.275059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.275031 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjwwv\"" Jul 16 20:34:02.278213 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.278192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzdgg" Jul 16 20:34:02.282276 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:02.282255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:34:03.285209 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.285184 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzdgg"] Jul 16 20:34:03.288947 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:03.288917 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f77d1b0_90c0_4145_a051_2983b5759704.slice/crio-3f41b2a0fed53dffa2a85d9b74239a037b27563349a94734c48f95162f8d4254 WatchSource:0}: Error finding container 3f41b2a0fed53dffa2a85d9b74239a037b27563349a94734c48f95162f8d4254: Status 404 returned error can't find the container with id 3f41b2a0fed53dffa2a85d9b74239a037b27563349a94734c48f95162f8d4254 Jul 16 20:34:03.306563 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.306541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4lg7m"] Jul 16 20:34:03.310070 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:03.310023 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998e2b66_5eb3_4e01_8d8a_b71da0530af5.slice/crio-920695b6fc3599cfdd54f52630ae3a0d4de6725ae55ddd6a6a121a9a27e963f2 WatchSource:0}: Error finding container 920695b6fc3599cfdd54f52630ae3a0d4de6725ae55ddd6a6a121a9a27e963f2: Status 404 returned error can't find the container with id 920695b6fc3599cfdd54f52630ae3a0d4de6725ae55ddd6a6a121a9a27e963f2 Jul 16 20:34:03.331498 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.331410 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tk5wx"] Jul 16 20:34:03.334613 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:03.334582 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98aa95d_7c60_4bb5_96ea_dc665887bad8.slice/crio-6822b983e989d4bb1f91231a7d5bed5b2e53d834bac79fd9a3f6abb72eed7070 WatchSource:0}: Error finding container 6822b983e989d4bb1f91231a7d5bed5b2e53d834bac79fd9a3f6abb72eed7070: Status 404 returned error can't find the container with id 6822b983e989d4bb1f91231a7d5bed5b2e53d834bac79fd9a3f6abb72eed7070 Jul 16 20:34:03.575362 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.575283 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:03.619822 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.619785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4lg7m" event={"ID":"998e2b66-5eb3-4e01-8d8a-b71da0530af5","Type":"ContainerStarted","Data":"920695b6fc3599cfdd54f52630ae3a0d4de6725ae55ddd6a6a121a9a27e963f2"} Jul 16 20:34:03.620839 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.620811 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk5wx" event={"ID":"e98aa95d-7c60-4bb5-96ea-dc665887bad8","Type":"ContainerStarted","Data":"6822b983e989d4bb1f91231a7d5bed5b2e53d834bac79fd9a3f6abb72eed7070"} Jul 16 20:34:03.622769 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.622737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-697ss" event={"ID":"45b26552-8266-4349-9d2a-ed154157feeb","Type":"ContainerStarted","Data":"cdfaac583c8b3b383d3d4c36c05e1bcf920804406faef604ab93317a4e45bbbe"} Jul 16 20:34:03.623897 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.623875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzdgg" event={"ID":"2f77d1b0-90c0-4145-a051-2983b5759704","Type":"ContainerStarted","Data":"3f41b2a0fed53dffa2a85d9b74239a037b27563349a94734c48f95162f8d4254"} Jul 16 20:34:03.640995 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.640952 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-697ss" podStartSLOduration=1.2934867190000001 podStartE2EDuration="16.640935597s" totalImagesPullingTime="15.347448878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:33:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:03.640053953 +0000 UTC m=+66.899013415" watchObservedRunningTime="2026-07-16 20:34:03.640935597 +0000 UTC m=+66.899895048" Jul 16 20:34:03.738413 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.738382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:03.784488 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.784456 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5"] Jul 16 20:34:03.788938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.788923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:03.793978 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.793950 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xl964\"" Jul 16 20:34:03.794078 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.794023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 20:34:03.794322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.794307 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 20:34:03.799838 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.799819 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5"] Jul 16 20:34:03.832505 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.832420 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gpv8q"] Jul 16 20:34:03.835868 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.835834 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.839780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.839735 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 20:34:03.839780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.839768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 20:34:03.840241 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.840216 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 20:34:03.840496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.840480 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-l8dm8\"" Jul 16 20:34:03.850008 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.849981 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:03.854673 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.854650 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lsfdm"] Jul 16 20:34:03.858110 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.858091 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gpv8q"] Jul 16 20:34:03.858233 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.858220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.860930 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.860837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 20:34:03.860930 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.860874 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 20:34:03.861085 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.860939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 20:34:03.861085 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.860841 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zmp64\"" Jul 16 20:34:03.927305 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.927244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:03.929097 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929074 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:03.929240 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929136 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:03.929240 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5049de09-9120-4652-a0fe-0ff76002990c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:03.929337 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngmm\" (UniqueName: \"kubernetes.io/projected/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-kube-api-access-lngmm\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929337 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-textfile\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929337 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.929477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-tls\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.929477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:03.929477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-metrics-client-ca\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.929658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-wtmp\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-root\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.929824 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57af89b8-f248-4dec-a3d9-504f7aec4181-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.929824 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.929824 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:03.930001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479n9\" (UniqueName: \"kubernetes.io/projected/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-api-access-479n9\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:03.930001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.930001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-sys\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:03.930001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.929990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj64d\" (UniqueName: \"kubernetes.io/projected/5049de09-9120-4652-a0fe-0ff76002990c-kube-api-access-bj64d\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:03.934387 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:03.934369 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:04.031265 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-textfile\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-tls\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-metrics-client-ca\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-wtmp\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-root\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57af89b8-f248-4dec-a3d9-504f7aec4181-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-479n9\" (UniqueName: \"kubernetes.io/projected/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-api-access-479n9\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031588 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-textfile\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-wtmp\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-sys\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj64d\" (UniqueName: \"kubernetes.io/projected/5049de09-9120-4652-a0fe-0ff76002990c-kube-api-access-bj64d\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5049de09-9120-4652-a0fe-0ff76002990c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.031836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngmm\" (UniqueName: \"kubernetes.io/projected/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-kube-api-access-lngmm\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.032227 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.031870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-root\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.032227 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57af89b8-f248-4dec-a3d9-504f7aec4181-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.032331 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.032825 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032748 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-metrics-client-ca\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.032825 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032803 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5049de09-9120-4652-a0fe-0ff76002990c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.033049 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57af89b8-f248-4dec-a3d9-504f7aec4181-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.033049 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:04.032927 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 16 20:34:04.033049 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.032931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-sys\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.033049 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:04.032984 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls podName:5049de09-9120-4652-a0fe-0ff76002990c nodeName:}" failed. No retries permitted until 2026-07-16 20:34:04.532965991 +0000 UTC m=+67.791925418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-mkwp5" (UID: "5049de09-9120-4652-a0fe-0ff76002990c") : secret "openshift-state-metrics-tls" not found Jul 16 20:34:04.033636 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.033608 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.035229 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.035204 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-tls\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.035380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.035329 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.035492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.035466 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.035600 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.035575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.035745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.035691 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.036306 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.036279 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.042232 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.042191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngmm\" (UniqueName: \"kubernetes.io/projected/2f3b31eb-61a7-476d-b3be-2fc0b91e891d-kube-api-access-lngmm\") pod \"node-exporter-lsfdm\" (UID: \"2f3b31eb-61a7-476d-b3be-2fc0b91e891d\") " pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.042650 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.042633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj64d\" (UniqueName: \"kubernetes.io/projected/5049de09-9120-4652-a0fe-0ff76002990c-kube-api-access-bj64d\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.044116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.044099 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-479n9\" (UniqueName: \"kubernetes.io/projected/57af89b8-f248-4dec-a3d9-504f7aec4181-kube-api-access-479n9\") pod \"kube-state-metrics-56c5594674-gpv8q\" (UID: \"57af89b8-f248-4dec-a3d9-504f7aec4181\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.135733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.135662 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.158657 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.158299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" Jul 16 20:34:04.169595 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.169571 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lsfdm" Jul 16 20:34:04.231928 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.231690 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.326592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.326396 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gpv8q"] Jul 16 20:34:04.329395 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:04.329366 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57af89b8_f248_4dec_a3d9_504f7aec4181.slice/crio-0d8436c2e045850a09fd3f005fcc36e49162d609aebf93334d9376483c593985 WatchSource:0}: Error finding container 0d8436c2e045850a09fd3f005fcc36e49162d609aebf93334d9376483c593985: Status 404 returned error can't find the container with id 0d8436c2e045850a09fd3f005fcc36e49162d609aebf93334d9376483c593985 Jul 16 20:34:04.335617 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.335520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.480527 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.480433 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.536099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.536068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.539035 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.539013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5049de09-9120-4652-a0fe-0ff76002990c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-mkwp5\" (UID: \"5049de09-9120-4652-a0fe-0ff76002990c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.569812 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.569788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s6pj4" Jul 16 20:34:04.635943 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.629589 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" event={"ID":"57af89b8-f248-4dec-a3d9-504f7aec4181","Type":"ContainerStarted","Data":"0d8436c2e045850a09fd3f005fcc36e49162d609aebf93334d9376483c593985"} Jul 16 20:34:04.635943 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.631092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lsfdm" event={"ID":"2f3b31eb-61a7-476d-b3be-2fc0b91e891d","Type":"ContainerStarted","Data":"0cc2834d2983a372337d4a0373e804906d062d1807024f7f41887b2c2e1bd310"} Jul 16 20:34:04.636137 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.636007 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:04.697880 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.697848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" Jul 16 20:34:04.864532 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.864458 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.875687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.875554 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5"] Jul 16 20:34:04.970826 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.970750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:04.976527 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.976503 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:34:04.981332 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.981311 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.990509 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.990772 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.990996 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.991238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.991439 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-55wzw\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.991651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.991879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.992106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.992288 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 20:34:04.992950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:04.992498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 20:34:05.007774 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.007688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:34:05.041935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.041935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.041935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.041935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.041935 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.041996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7j5\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.042022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.042054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.042096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.042126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.042172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.042155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.076348 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.076155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:05.142965 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.142927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.142988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7j5\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143125 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.143666 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.143351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.144579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.144400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.146354 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.146038 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.146354 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.146315 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.146717 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.146688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.147749 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.147708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.148673 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.148631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.151108 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.150597 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.151108 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.150665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.151108 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.150841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.151561 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.151519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.151651 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.151619 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.153156 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.153102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.154288 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.154261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7j5\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5\") pod \"alertmanager-main-0\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.310084 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.309784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:34:05.638270 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.638231 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk5wx" event={"ID":"e98aa95d-7c60-4bb5-96ea-dc665887bad8","Type":"ContainerStarted","Data":"a9aff5526e153460f8a85a9d715a9dbbb0f9ebcec25543b9c069c4f44562bc88"} Jul 16 20:34:05.638716 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.638298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tk5wx" event={"ID":"e98aa95d-7c60-4bb5-96ea-dc665887bad8","Type":"ContainerStarted","Data":"19952ea3c37b1673c06a1f154792f1528687c7a22ca4f7c3d2ec1e6674debeb2"} Jul 16 20:34:05.642853 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.642826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" event={"ID":"5049de09-9120-4652-a0fe-0ff76002990c","Type":"ContainerStarted","Data":"36edfebb1f83fc481bc3acd60d98b0bb383ccd068a93eac29e0f83804d913964"} Jul 16 20:34:05.642988 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.642887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" event={"ID":"5049de09-9120-4652-a0fe-0ff76002990c","Type":"ContainerStarted","Data":"0777a78c9a03a9e4bbf32092da79fd522861a981e235ce1d64620fd88d5c45a4"} Jul 16 20:34:05.642988 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.642938 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" event={"ID":"5049de09-9120-4652-a0fe-0ff76002990c","Type":"ContainerStarted","Data":"3d2976422e4ff8ea33dcfe9bbfc693cae0e201633ce9c03e11d946b94a4e43d8"} Jul 16 20:34:05.659641 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.659595 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tk5wx" podStartSLOduration=67.324221179 podStartE2EDuration="1m8.659579469s" totalImagesPullingTime="1.33535829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:05.658380666 +0000 UTC m=+68.917340125" watchObservedRunningTime="2026-07-16 20:34:05.659579469 +0000 UTC m=+68.918538980" Jul 16 20:34:05.838386 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.838353 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:05.930691 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.930579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:05.931939 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.931897 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-576754b96d-6qphd"] Jul 16 20:34:05.937890 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.937870 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:05.941180 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941158 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-69dlta8rsg8he\"" Jul 16 20:34:05.941282 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 20:34:05.941351 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 20:34:05.941428 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941412 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xnw6h\"" Jul 16 20:34:05.941595 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941579 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 20:34:05.941660 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 20:34:05.941660 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.941606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 20:34:05.973099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:05.973072 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576754b96d-6qphd"] Jul 16 20:34:06.051878 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.051839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gscdr\" (UniqueName: \"kubernetes.io/projected/f8639272-7910-4b06-a7d8-0c313794da90-kube-api-access-gscdr\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.051878 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.051882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.051923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.051952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8639272-7910-4b06-a7d8-0c313794da90-metrics-client-ca\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.051998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.052028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-grpc-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.052053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.052152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.052121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.152869 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.152835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.152876 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-grpc-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.152924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.152972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.153023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gscdr\" (UniqueName: \"kubernetes.io/projected/f8639272-7910-4b06-a7d8-0c313794da90-kube-api-access-gscdr\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.153048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.153072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.153289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.153099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8639272-7910-4b06-a7d8-0c313794da90-metrics-client-ca\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.154008 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.153954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8639272-7910-4b06-a7d8-0c313794da90-metrics-client-ca\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.156340 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.156271 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.156340 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.156286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-grpc-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.156666 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.156633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.156757 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.156692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.156857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.156840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-tls\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.158498 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.158477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8639272-7910-4b06-a7d8-0c313794da90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.165746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.165723 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gscdr\" (UniqueName: \"kubernetes.io/projected/f8639272-7910-4b06-a7d8-0c313794da90-kube-api-access-gscdr\") pod \"thanos-querier-576754b96d-6qphd\" (UID: \"f8639272-7910-4b06-a7d8-0c313794da90\") " pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.277113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.277027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:06.322960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.322935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:06.323099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.322995 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:06.327948 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.327925 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:06.652173 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.652111 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:06.703760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.703725 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:34:06.860983 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.860955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:06.967923 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:06.965158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:07.065630 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.065535 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:34:07.095246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.095048 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576754b96d-6qphd"] Jul 16 20:34:07.105072 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:07.105044 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8639272_7910_4b06_a7d8_0c313794da90.slice/crio-7267799f54fe081ba7427d619d5f11a2aef17a3f1a11a2a6a6ef2c080fa3e686 WatchSource:0}: Error finding container 7267799f54fe081ba7427d619d5f11a2aef17a3f1a11a2a6a6ef2c080fa3e686: Status 404 returned error can't find the container with id 7267799f54fe081ba7427d619d5f11a2aef17a3f1a11a2a6a6ef2c080fa3e686 Jul 16 20:34:07.222127 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.222091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:07.300183 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.300145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:07.653218 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.653181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"63f55cd0885ed7d7b7511029e1792caa438255f82685edfeb49708fb901dc117"} Jul 16 20:34:07.655129 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.654817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4lg7m" event={"ID":"998e2b66-5eb3-4e01-8d8a-b71da0530af5","Type":"ContainerStarted","Data":"b77b2cb6fb91cc8865d85de328a0088a5033ca3005e949e8df8f76cc3b105da2"} Jul 16 20:34:07.655129 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.654945 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:34:07.657550 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.657525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" event={"ID":"57af89b8-f248-4dec-a3d9-504f7aec4181","Type":"ContainerStarted","Data":"a2910314acd318ff5d8285c7a8c3671f22f0958303d5b2f8708c94962f2f4254"} Jul 16 20:34:07.657659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.657578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" event={"ID":"57af89b8-f248-4dec-a3d9-504f7aec4181","Type":"ContainerStarted","Data":"037272d514755a087ddabb1772f62f36edc64412c1fb1266734b294e12d1cb5e"} Jul 16 20:34:07.657659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.657617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" event={"ID":"57af89b8-f248-4dec-a3d9-504f7aec4181","Type":"ContainerStarted","Data":"2a0e70985ccba7b29c6369cef74c8147a3dd42d2f31054122e934f52018b225c"} Jul 16 20:34:07.659302 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.659278 2563 generic.go:356] "Generic (PLEG): container finished" podID="2f3b31eb-61a7-476d-b3be-2fc0b91e891d" containerID="9c133f308d3fabe4467384f8debac638163c766683b60ad77dd2c85f953cb1c8" exitCode=0 Jul 16 20:34:07.659392 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.659355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lsfdm" event={"ID":"2f3b31eb-61a7-476d-b3be-2fc0b91e891d","Type":"ContainerDied","Data":"9c133f308d3fabe4467384f8debac638163c766683b60ad77dd2c85f953cb1c8"} Jul 16 20:34:07.660636 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.660554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"7267799f54fe081ba7427d619d5f11a2aef17a3f1a11a2a6a6ef2c080fa3e686"} Jul 16 20:34:07.681884 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.681843 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4lg7m" podStartSLOduration=67.120473929 podStartE2EDuration="1m10.681827934s" totalImagesPullingTime="3.561354005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:07.681602003 +0000 UTC m=+70.940561454" watchObservedRunningTime="2026-07-16 20:34:07.681827934 +0000 UTC m=+70.940787407" Jul 16 20:34:07.712406 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:07.712344 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-gpv8q" podStartSLOduration=2.177780219 podStartE2EDuration="4.712324939s" totalImagesPullingTime="2.53454472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:07.711783057 +0000 UTC m=+70.970742507" watchObservedRunningTime="2026-07-16 20:34:07.712324939 +0000 UTC m=+70.971284389" Jul 16 20:34:08.017172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.017066 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:08.119515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.119479 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:08.328063 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.327983 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5df884696d-hrzdh"] Jul 16 20:34:08.331447 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.331422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.337753 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.337706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 20:34:08.337919 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.337787 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 20:34:08.338174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.338146 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 20:34:08.340103 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.338895 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a1l7sp13um4fh\"" Jul 16 20:34:08.340103 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.339148 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 20:34:08.340103 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.339396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5twfw\"" Jul 16 20:34:08.351146 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.351113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df884696d-hrzdh"] Jul 16 20:34:08.477502 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddl6b\" (UniqueName: \"kubernetes.io/projected/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-kube-api-access-ddl6b\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-tls\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-client-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-metrics-server-audit-profiles\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-client-certs\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.477955 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.477867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-audit-log\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.559095 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.559061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:08.579417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-tls\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-client-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-metrics-server-audit-profiles\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579678 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-client-certs\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579678 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-audit-log\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.579782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.579718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddl6b\" (UniqueName: \"kubernetes.io/projected/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-kube-api-access-ddl6b\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.580322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.580229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-audit-log\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.580592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.580360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.580592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.580483 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-metrics-server-audit-profiles\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.582453 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.582428 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-tls\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.582570 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.582551 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-client-ca-bundle\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.585460 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.585434 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-secret-metrics-server-client-certs\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.596311 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.596290 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddl6b\" (UniqueName: \"kubernetes.io/projected/7568d7cf-3aa5-4fe3-ab38-4f8879dacc40-kube-api-access-ddl6b\") pod \"metrics-server-5df884696d-hrzdh\" (UID: \"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40\") " pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.596820 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.596794 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr"] Jul 16 20:34:08.601712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.601695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.605085 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.605054 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 20:34:08.605205 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.605099 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8gf9l\"" Jul 16 20:34:08.612593 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.612569 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr"] Jul 16 20:34:08.644228 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.644194 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:08.661124 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.661074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:08.672745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.672719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lsfdm" event={"ID":"2f3b31eb-61a7-476d-b3be-2fc0b91e891d","Type":"ContainerStarted","Data":"352a0c3d1b20d4f63a0e1f07d3b27f573db2f1d8a7d843d93c05738037c95491"} Jul 16 20:34:08.672865 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.672773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lsfdm" event={"ID":"2f3b31eb-61a7-476d-b3be-2fc0b91e891d","Type":"ContainerStarted","Data":"60f7e04eb7dbd928260d4199f6cd64b658ed0f2df241c1bf8148ab0df259c70d"} Jul 16 20:34:08.677573 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.676930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" event={"ID":"5049de09-9120-4652-a0fe-0ff76002990c","Type":"ContainerStarted","Data":"bdaebaabfe97afc1d26029209e5328a1788b461c00d910191ef72297298f83a5"} Jul 16 20:34:08.680839 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.680819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpm7r\" (UniqueName: \"kubernetes.io/projected/8b540ee5-3ade-4d45-a38b-0cae1d513d62-kube-api-access-hpm7r\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.680961 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.680874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.694762 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.694713 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lsfdm" podStartSLOduration=2.877991488 podStartE2EDuration="5.694698573s" totalImagesPullingTime="2.674046256s" totalInitContainerRuntime="142.660829ms" isStatefulPod=true podCreationTimestamp="2026-07-16 20:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:08.693074158 +0000 UTC m=+71.952033609" watchObservedRunningTime="2026-07-16 20:34:08.694698573 +0000 UTC m=+71.953658039" Jul 16 20:34:08.715797 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.715739 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-mkwp5" podStartSLOduration=3.093161276 podStartE2EDuration="5.715712878s" totalImagesPullingTime="2.622551602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:08.714588032 +0000 UTC m=+71.973547484" watchObservedRunningTime="2026-07-16 20:34:08.715712878 +0000 UTC m=+71.974672328" Jul 16 20:34:08.782083 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.782052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpm7r\" (UniqueName: \"kubernetes.io/projected/8b540ee5-3ade-4d45-a38b-0cae1d513d62-kube-api-access-hpm7r\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.782254 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.782150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.783033 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:08.782996 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 20:34:08.783172 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:08.783089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert podName:8b540ee5-3ade-4d45-a38b-0cae1d513d62 nodeName:}" failed. No retries permitted until 2026-07-16 20:34:09.28306932 +0000 UTC m=+72.542028747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-nmvrr" (UID: "8b540ee5-3ade-4d45-a38b-0cae1d513d62") : secret "monitoring-plugin-cert" not found Jul 16 20:34:08.791977 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.791954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpm7r\" (UniqueName: \"kubernetes.io/projected/8b540ee5-3ade-4d45-a38b-0cae1d513d62-kube-api-access-hpm7r\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:08.805059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.804995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df884696d-hrzdh"] Jul 16 20:34:08.807847 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:08.807815 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7568d7cf_3aa5_4fe3_ab38_4f8879dacc40.slice/crio-cce6f0b30ad7d9b7c7420588343cee2911819459661a8891dc74ec1e8f91eab1 WatchSource:0}: Error finding container cce6f0b30ad7d9b7c7420588343cee2911819459661a8891dc74ec1e8f91eab1: Status 404 returned error can't find the container with id cce6f0b30ad7d9b7c7420588343cee2911819459661a8891dc74ec1e8f91eab1 Jul 16 20:34:08.930123 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:08.930086 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:09.290936 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:09.290829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:09.293979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:09.293954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b540ee5-3ade-4d45-a38b-0cae1d513d62-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nmvrr\" (UID: \"8b540ee5-3ade-4d45-a38b-0cae1d513d62\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:09.519692 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:09.519654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:09.681368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:09.681330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" event={"ID":"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40","Type":"ContainerStarted","Data":"cce6f0b30ad7d9b7c7420588343cee2911819459661a8891dc74ec1e8f91eab1"} Jul 16 20:34:10.143772 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:10.143703 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:11.179711 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.179679 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr"] Jul 16 20:34:11.183568 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:11.183544 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b540ee5_3ade_4d45_a38b_0cae1d513d62.slice/crio-13686a402f338e51251cf116bd9fe8189526a3ab72826b43ffc5cbe075a49f5f WatchSource:0}: Error finding container 13686a402f338e51251cf116bd9fe8189526a3ab72826b43ffc5cbe075a49f5f: Status 404 returned error can't find the container with id 13686a402f338e51251cf116bd9fe8189526a3ab72826b43ffc5cbe075a49f5f Jul 16 20:34:11.605005 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.604935 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:34:11.607971 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.607948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.621483 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.621447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:11.633159 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.633131 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:34:11.692015 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.691972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzdgg" event={"ID":"2f77d1b0-90c0-4145-a051-2983b5759704","Type":"ContainerStarted","Data":"9738408cee31907d6c665e8d666b0c0eb522881072ed2a2af31aa0c6ffafd02c"} Jul 16 20:34:11.694049 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.694023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"7f1bbefb245aa8c701fb7f08e0894b24ebbb902d77e484e4ae0f57759eccbd5a"} Jul 16 20:34:11.694169 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.694085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"105ad5a21e9c61db61f5222122a9929e459c438987581465ab9110a4d71e37d7"} Jul 16 20:34:11.694169 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.694128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"824ff6f45c7a4c61db1cf47bbce956e29c0aa52a3b4153135b5758c777ec17dd"} Jul 16 20:34:11.695163 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.695141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" event={"ID":"8b540ee5-3ade-4d45-a38b-0cae1d513d62","Type":"ContainerStarted","Data":"13686a402f338e51251cf116bd9fe8189526a3ab72826b43ffc5cbe075a49f5f"} Jul 16 20:34:11.708042 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.708001 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xzdgg" podStartSLOduration=65.885515527 podStartE2EDuration="1m13.707986913s" totalImagesPullingTime="7.822471386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 20:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:11.707446589 +0000 UTC m=+74.966406039" watchObservedRunningTime="2026-07-16 20:34:11.707986913 +0000 UTC m=+74.966946362" Jul 16 20:34:11.713420 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8gp\" (UniqueName: \"kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713699 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.713699 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.713599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.714029 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.714008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:11.814374 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814344 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814671 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8gp\" (UniqueName: \"kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.814671 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.814517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.819631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.815456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.819631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.815656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.819631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.815798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.819631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.815963 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.820248 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.820229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.820292 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.820257 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.824018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.824003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8gp\" (UniqueName: \"kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp\") pod \"console-f66575c47-h2glv\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:11.916384 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:11.916177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:12.062149 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.062117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:34:12.183016 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:34:12.182944 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00691265_fe4d_4aa3_a2ed_ccaa50d6a77d.slice/crio-f1e7a01df3598ab6b3df58c433b360c6e84de43ab48c5cfbb8553adf09265796 WatchSource:0}: Error finding container f1e7a01df3598ab6b3df58c433b360c6e84de43ab48c5cfbb8553adf09265796: Status 404 returned error can't find the container with id f1e7a01df3598ab6b3df58c433b360c6e84de43ab48c5cfbb8553adf09265796 Jul 16 20:34:12.217191 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.217162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:12.274811 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.274780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:12.702379 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.702354 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"760983366b146e30090683614c337e13d5a683ed3b6da64dbc29d507b4892e59"} Jul 16 20:34:12.702507 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.702443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"bcfc376684935417aa10050b4367f98c7de0e3cee56c6a6e5225e135012a18cf"} Jul 16 20:34:12.702507 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.702482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" event={"ID":"f8639272-7910-4b06-a7d8-0c313794da90","Type":"ContainerStarted","Data":"435bc8756c95e6bee84a9b1fb065bee143818eddc28b8d3e2e4979f821bfeb8c"} Jul 16 20:34:12.702640 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.702618 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:12.704110 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.704077 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2" exitCode=0 Jul 16 20:34:12.704210 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.704166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2"} Jul 16 20:34:12.706350 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.706329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66575c47-h2glv" event={"ID":"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d","Type":"ContainerStarted","Data":"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889"} Jul 16 20:34:12.706431 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.706367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66575c47-h2glv" event={"ID":"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d","Type":"ContainerStarted","Data":"f1e7a01df3598ab6b3df58c433b360c6e84de43ab48c5cfbb8553adf09265796"} Jul 16 20:34:12.725380 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.725308 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" podStartSLOduration=2.624884133 podStartE2EDuration="7.725293601s" totalImagesPullingTime="5.100409468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:12.723930776 +0000 UTC m=+75.982890225" watchObservedRunningTime="2026-07-16 20:34:12.725293601 +0000 UTC m=+75.984253050" Jul 16 20:34:12.765805 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:12.765762 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f66575c47-h2glv" podStartSLOduration=1.765749471 podStartE2EDuration="1.765749471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:12.764974553 +0000 UTC m=+76.023934001" watchObservedRunningTime="2026-07-16 20:34:12.765749471 +0000 UTC m=+76.024708920" Jul 16 20:34:14.717888 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:14.717848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" event={"ID":"7568d7cf-3aa5-4fe3-ab38-4f8879dacc40","Type":"ContainerStarted","Data":"2dd312ae881882983860ba3756fab0a0a106fb29b2e289e5b617be4a6c7f03d6"} Jul 16 20:34:14.738864 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:14.738819 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" podStartSLOduration=1.52962734 podStartE2EDuration="6.738805663s" totalImagesPullingTime="5.209178323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:14.737122888 +0000 UTC m=+77.996082343" watchObservedRunningTime="2026-07-16 20:34:14.738805663 +0000 UTC m=+77.997765111" Jul 16 20:34:15.605022 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.604931 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:15.706153 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.706102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:15.726058 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.726026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" event={"ID":"8b540ee5-3ade-4d45-a38b-0cae1d513d62","Type":"ContainerStarted","Data":"fced130ed7489bd19bf8b0f00b0fa50d392855387231a43031d5ce8f4f85f9ab"} Jul 16 20:34:15.726522 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.726358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:15.732238 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.732203 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" Jul 16 20:34:15.743304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:15.743260 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nmvrr" podStartSLOduration=4.061981142 podStartE2EDuration="7.743246104s" totalImagesPullingTime="3.681264962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:15.742061925 +0000 UTC m=+79.001021387" watchObservedRunningTime="2026-07-16 20:34:15.743246104 +0000 UTC m=+79.002205574" Jul 16 20:34:16.732396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:16.732372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415"} Jul 16 20:34:16.732760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:16.732459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab"} Jul 16 20:34:16.732760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:16.732506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938"} Jul 16 20:34:16.732760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:16.732553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0"} Jul 16 20:34:16.732760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:16.732592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac"} Jul 16 20:34:17.399698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:17.399668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:17.500680 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:17.500594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:17.739241 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:17.739168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerStarted","Data":"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548"} Jul 16 20:34:17.768163 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:17.767791 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.868570314 podStartE2EDuration="13.767776166s" totalImagesPullingTime="8.882750821s" totalInitContainerRuntime="16.455031ms" isStatefulPod=false podCreationTimestamp="2026-07-16 20:34:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:34:17.76611493 +0000 UTC m=+81.025074400" watchObservedRunningTime="2026-07-16 20:34:17.767776166 +0000 UTC m=+81.026735615" Jul 16 20:34:18.719329 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:18.719303 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-576754b96d-6qphd" Jul 16 20:34:19.188179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:19.188140 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:19.278767 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:19.278723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:19.563026 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:19.562953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:21.229700 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:21.229670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:21.337698 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:21.337664 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:21.916624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:21.916589 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:21.916803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:21.916673 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:21.921644 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:21.921624 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:22.762277 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:22.762246 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:34:22.806614 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:22.806580 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:34:22.909479 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:22.909445 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:28.644485 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:28.644456 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:28.645056 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:28.644518 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:30.644070 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:30.644033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:30.700611 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:30.700579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:31.729772 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:31.729723 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85bb959744-ws7r6" podUID="cba1722d-9680-4dd6-acd7-eea9d4952563" containerName="console" containerID="cri-o://04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45" gracePeriod=15 Jul 16 20:34:32.497760 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.497735 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:32.592311 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592288 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592328 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592368 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592385 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592410 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592432 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592425 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzzt7\" (UniqueName: \"kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7\") pod \"cba1722d-9680-4dd6-acd7-eea9d4952563\" (UID: \"cba1722d-9680-4dd6-acd7-eea9d4952563\") " Jul 16 20:34:32.592801 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592774 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:32.592893 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592789 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca" (OuterVolumeSpecName: "service-ca") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:32.592893 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.592839 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config" (OuterVolumeSpecName: "console-config") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:32.594841 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.594815 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:34:32.594941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.594817 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7" (OuterVolumeSpecName: "kube-api-access-hzzt7") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "kube-api-access-hzzt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:34:32.594941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.594878 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cba1722d-9680-4dd6-acd7-eea9d4952563" (UID: "cba1722d-9680-4dd6-acd7-eea9d4952563"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:34:32.693050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693020 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.693050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693046 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.693206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693059 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cba1722d-9680-4dd6-acd7-eea9d4952563-console-oauth-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.693206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693072 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-console-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.693206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693083 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzzt7\" (UniqueName: \"kubernetes.io/projected/cba1722d-9680-4dd6-acd7-eea9d4952563-kube-api-access-hzzt7\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.693206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.693096 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cba1722d-9680-4dd6-acd7-eea9d4952563-oauth-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:32.800475 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.800441 2563 generic.go:356] "Generic (PLEG): container finished" podID="cba1722d-9680-4dd6-acd7-eea9d4952563" containerID="04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45" exitCode=0 Jul 16 20:34:32.800833 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.800491 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bb959744-ws7r6" Jul 16 20:34:32.800833 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.800530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb959744-ws7r6" event={"ID":"cba1722d-9680-4dd6-acd7-eea9d4952563","Type":"ContainerDied","Data":"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45"} Jul 16 20:34:32.800833 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.800583 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bb959744-ws7r6" event={"ID":"cba1722d-9680-4dd6-acd7-eea9d4952563","Type":"ContainerDied","Data":"aa8ba6e0afd94dea181a55ecefbcfee03d33302a083c780ed55f31ce597fc281"} Jul 16 20:34:32.800833 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.800609 2563 scope.go:117] "RemoveContainer" containerID="04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45" Jul 16 20:34:32.810018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.810001 2563 scope.go:117] "RemoveContainer" containerID="04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45" Jul 16 20:34:32.810311 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:32.810290 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45\": container with ID starting with 04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45 not found: ID does not exist" containerID="04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45" Jul 16 20:34:32.810361 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.810321 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45"} err="failed to get container status \"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45\": rpc error: code = NotFound desc = could not find container \"04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45\": container with ID starting with 04f51c0d0b5671011704756331bbb033973c38c36b7f99705de2c20235872d45 not found: ID does not exist" Jul 16 20:34:32.821401 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.821376 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:34:32.826843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:32.826825 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85bb959744-ws7r6"] Jul 16 20:34:33.258513 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:33.258484 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba1722d-9680-4dd6-acd7-eea9d4952563" path="/var/lib/kubelet/pods/cba1722d-9680-4dd6-acd7-eea9d4952563/volumes" Jul 16 20:34:37.301925 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:37.301878 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:37.401007 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:37.400972 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:38.679968 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:38.679942 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4lg7m" Jul 16 20:34:47.829152 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:47.829095 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c865f457d-ghv8r" podUID="6cad81ea-8dcc-42d0-9acc-350d834708bf" containerName="console" containerID="cri-o://3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512" gracePeriod=15 Jul 16 20:34:48.062134 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.062110 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:48.110712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110649 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110684 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110710 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110740 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110764 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110806 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgtgr\" (UniqueName: \"kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.110960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.110853 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config\") pod \"6cad81ea-8dcc-42d0-9acc-350d834708bf\" (UID: \"6cad81ea-8dcc-42d0-9acc-350d834708bf\") " Jul 16 20:34:48.111225 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.111113 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca" (OuterVolumeSpecName: "service-ca") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:48.111283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.111241 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:48.111339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.111271 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config" (OuterVolumeSpecName: "console-config") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:48.111433 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.111413 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:34:48.113107 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.113082 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:34:48.113206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.113125 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr" (OuterVolumeSpecName: "kube-api-access-qgtgr") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "kube-api-access-qgtgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:34:48.113206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.113162 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6cad81ea-8dcc-42d0-9acc-350d834708bf" (UID: "6cad81ea-8dcc-42d0-9acc-350d834708bf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:34:48.211843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211806 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.211843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211839 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.212050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211852 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-trusted-ca-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.212050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211865 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-oauth-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.212050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211877 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.212050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211888 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgtgr\" (UniqueName: \"kubernetes.io/projected/6cad81ea-8dcc-42d0-9acc-350d834708bf-kube-api-access-qgtgr\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.212050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.211923 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cad81ea-8dcc-42d0-9acc-350d834708bf-console-oauth-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:34:48.649457 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.649428 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:48.653129 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.653107 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5df884696d-hrzdh" Jul 16 20:34:48.867736 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.867695 2563 generic.go:356] "Generic (PLEG): container finished" podID="6cad81ea-8dcc-42d0-9acc-350d834708bf" containerID="3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512" exitCode=0 Jul 16 20:34:48.867736 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.867740 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c865f457d-ghv8r" Jul 16 20:34:48.868168 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.867782 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c865f457d-ghv8r" event={"ID":"6cad81ea-8dcc-42d0-9acc-350d834708bf","Type":"ContainerDied","Data":"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512"} Jul 16 20:34:48.868168 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.867834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c865f457d-ghv8r" event={"ID":"6cad81ea-8dcc-42d0-9acc-350d834708bf","Type":"ContainerDied","Data":"31e519f864ad8d7ec1d9a1c56065661f7bb4033e30051f543e4d490d076cd647"} Jul 16 20:34:48.868168 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.867859 2563 scope.go:117] "RemoveContainer" containerID="3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512" Jul 16 20:34:48.876751 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.876737 2563 scope.go:117] "RemoveContainer" containerID="3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512" Jul 16 20:34:48.877039 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:34:48.877014 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512\": container with ID starting with 3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512 not found: ID does not exist" containerID="3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512" Jul 16 20:34:48.877098 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.877048 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512"} err="failed to get container status \"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512\": rpc error: code = NotFound desc = could not find container \"3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512\": container with ID starting with 3f96ced656f6cc92465f8cd388fbcd9799689801f426e9c5575a84d2525d7512 not found: ID does not exist" Jul 16 20:34:48.888511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.888487 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:34:48.891849 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:48.891829 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c865f457d-ghv8r"] Jul 16 20:34:49.258949 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:49.258892 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cad81ea-8dcc-42d0-9acc-350d834708bf" path="/var/lib/kubelet/pods/6cad81ea-8dcc-42d0-9acc-350d834708bf/volumes" Jul 16 20:34:55.199124 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:55.199090 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:55.298751 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:55.298714 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:34:55.326590 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:55.326562 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xgw6_7ba723ad-a6de-4209-a4fa-ca7492999cc4/serve-healthcheck-canary/0.log" Jul 16 20:34:55.601343 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:34:55.601273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:06.586676 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:06.586573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:23.144138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:23.144091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:23.527220 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:23.527099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:24.206028 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.205994 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:24.206559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206371 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="alertmanager" containerID="cri-o://46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" gracePeriod=120 Jul 16 20:35:24.206559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206423 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-web" containerID="cri-o://4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" gracePeriod=120 Jul 16 20:35:24.206559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206475 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="config-reloader" containerID="cri-o://6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" gracePeriod=120 Jul 16 20:35:24.206559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206497 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="prom-label-proxy" containerID="cri-o://d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" gracePeriod=120 Jul 16 20:35:24.206809 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206477 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy" containerID="cri-o://cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" gracePeriod=120 Jul 16 20:35:24.206809 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:24.206423 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-metric" containerID="cri-o://24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" gracePeriod=120 Jul 16 20:35:25.012020 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.011987 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" exitCode=0 Jul 16 20:35:25.012020 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012014 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" exitCode=0 Jul 16 20:35:25.012020 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012021 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" exitCode=0 Jul 16 20:35:25.012020 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012027 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" exitCode=0 Jul 16 20:35:25.012286 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012064 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548"} Jul 16 20:35:25.012286 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab"} Jul 16 20:35:25.012286 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0"} Jul 16 20:35:25.012286 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.012208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac"} Jul 16 20:35:25.443104 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.443083 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:25.509219 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509186 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl7j5\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509248 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509277 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509319 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509373 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509434 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509463 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509495 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509542 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509572 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509612 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.509653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.509639 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web\") pod \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\" (UID: \"b983e88c-8af7-4d75-89fc-bb3231a7d95e\") " Jul 16 20:35:25.510519 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.510206 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:35:25.511598 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.511536 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:35:25.513331 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513300 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5" (OuterVolumeSpecName: "kube-api-access-nl7j5") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "kube-api-access-nl7j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:35:25.513548 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513505 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.513642 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513616 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:35:25.513744 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513710 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:35:25.513814 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513779 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out" (OuterVolumeSpecName: "config-out") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:35:25.513869 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513828 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.513996 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.513966 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.514605 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.514578 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.514996 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.514967 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume" (OuterVolumeSpecName: "config-volume") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.519105 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.519078 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.524653 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.524633 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config" (OuterVolumeSpecName: "web-config") pod "b983e88c-8af7-4d75-89fc-bb3231a7d95e" (UID: "b983e88c-8af7-4d75-89fc-bb3231a7d95e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:35:25.610285 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610258 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-out\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610285 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610283 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610294 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610304 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-config-volume\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610313 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-main-db\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610322 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-cluster-tls-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610330 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610339 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610348 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl7j5\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-kube-api-access-nl7j5\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610358 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-secret-alertmanager-main-tls\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610366 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b983e88c-8af7-4d75-89fc-bb3231a7d95e-web-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610373 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b983e88c-8af7-4d75-89fc-bb3231a7d95e-tls-assets\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:25.610467 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:25.610380 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b983e88c-8af7-4d75-89fc-bb3231a7d95e-metrics-client-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:35:26.018923 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.018867 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" exitCode=0 Jul 16 20:35:26.018923 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.018893 2563 generic.go:356] "Generic (PLEG): container finished" podID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerID="4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" exitCode=0 Jul 16 20:35:26.019174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.018941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415"} Jul 16 20:35:26.019174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.018981 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.019174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.019016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938"} Jul 16 20:35:26.019174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.019046 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b983e88c-8af7-4d75-89fc-bb3231a7d95e","Type":"ContainerDied","Data":"63f55cd0885ed7d7b7511029e1792caa438255f82685edfeb49708fb901dc117"} Jul 16 20:35:26.019174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.019076 2563 scope.go:117] "RemoveContainer" containerID="d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" Jul 16 20:35:26.027069 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.027046 2563 scope.go:117] "RemoveContainer" containerID="24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" Jul 16 20:35:26.034136 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.034124 2563 scope.go:117] "RemoveContainer" containerID="cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" Jul 16 20:35:26.040877 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.040856 2563 scope.go:117] "RemoveContainer" containerID="4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" Jul 16 20:35:26.042585 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.042569 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:26.046825 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.046801 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:26.048528 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.048511 2563 scope.go:117] "RemoveContainer" containerID="6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" Jul 16 20:35:26.055120 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.055104 2563 scope.go:117] "RemoveContainer" containerID="46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" Jul 16 20:35:26.061958 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.061940 2563 scope.go:117] "RemoveContainer" containerID="cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2" Jul 16 20:35:26.068785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.068770 2563 scope.go:117] "RemoveContainer" containerID="d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" Jul 16 20:35:26.069153 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.069134 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548\": container with ID starting with d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548 not found: ID does not exist" containerID="d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" Jul 16 20:35:26.069209 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069161 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548"} err="failed to get container status \"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548\": rpc error: code = NotFound desc = could not find container \"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548\": container with ID starting with d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548 not found: ID does not exist" Jul 16 20:35:26.069209 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069183 2563 scope.go:117] "RemoveContainer" containerID="24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" Jul 16 20:35:26.069442 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.069416 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415\": container with ID starting with 24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415 not found: ID does not exist" containerID="24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" Jul 16 20:35:26.069554 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069451 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415"} err="failed to get container status \"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415\": rpc error: code = NotFound desc = could not find container \"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415\": container with ID starting with 24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415 not found: ID does not exist" Jul 16 20:35:26.069554 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069473 2563 scope.go:117] "RemoveContainer" containerID="cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" Jul 16 20:35:26.069747 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.069730 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab\": container with ID starting with cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab not found: ID does not exist" containerID="cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" Jul 16 20:35:26.069785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069752 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab"} err="failed to get container status \"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab\": rpc error: code = NotFound desc = could not find container \"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab\": container with ID starting with cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab not found: ID does not exist" Jul 16 20:35:26.069785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.069767 2563 scope.go:117] "RemoveContainer" containerID="4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" Jul 16 20:35:26.070046 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.070027 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938\": container with ID starting with 4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938 not found: ID does not exist" containerID="4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" Jul 16 20:35:26.070094 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070050 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938"} err="failed to get container status \"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938\": rpc error: code = NotFound desc = could not find container \"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938\": container with ID starting with 4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938 not found: ID does not exist" Jul 16 20:35:26.070094 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070064 2563 scope.go:117] "RemoveContainer" containerID="6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" Jul 16 20:35:26.070281 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.070265 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0\": container with ID starting with 6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0 not found: ID does not exist" containerID="6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" Jul 16 20:35:26.070339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070288 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0"} err="failed to get container status \"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0\": rpc error: code = NotFound desc = could not find container \"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0\": container with ID starting with 6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0 not found: ID does not exist" Jul 16 20:35:26.070339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070306 2563 scope.go:117] "RemoveContainer" containerID="46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" Jul 16 20:35:26.070535 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.070520 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac\": container with ID starting with 46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac not found: ID does not exist" containerID="46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" Jul 16 20:35:26.070571 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070538 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac"} err="failed to get container status \"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac\": rpc error: code = NotFound desc = could not find container \"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac\": container with ID starting with 46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac not found: ID does not exist" Jul 16 20:35:26.070571 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070552 2563 scope.go:117] "RemoveContainer" containerID="cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2" Jul 16 20:35:26.070785 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:35:26.070769 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2\": container with ID starting with cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2 not found: ID does not exist" containerID="cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2" Jul 16 20:35:26.070831 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070788 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2"} err="failed to get container status \"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2\": rpc error: code = NotFound desc = could not find container \"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2\": container with ID starting with cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2 not found: ID does not exist" Jul 16 20:35:26.070831 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.070804 2563 scope.go:117] "RemoveContainer" containerID="d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548" Jul 16 20:35:26.071072 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071054 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548"} err="failed to get container status \"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548\": rpc error: code = NotFound desc = could not find container \"d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548\": container with ID starting with d3ffd684fb1bf7ccd59c1f9790127dcb2d565009c69b6104b9aad25e1ca7d548 not found: ID does not exist" Jul 16 20:35:26.071135 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071072 2563 scope.go:117] "RemoveContainer" containerID="24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415" Jul 16 20:35:26.071274 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071261 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415"} err="failed to get container status \"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415\": rpc error: code = NotFound desc = could not find container \"24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415\": container with ID starting with 24e3f90d9226d79dfb12b06ea22822eb764b6ca5c67d80ed74877adbb13d4415 not found: ID does not exist" Jul 16 20:35:26.071321 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071274 2563 scope.go:117] "RemoveContainer" containerID="cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab" Jul 16 20:35:26.071476 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071458 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab"} err="failed to get container status \"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab\": rpc error: code = NotFound desc = could not find container \"cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab\": container with ID starting with cdbca6a6df3b0e9e03900503535b5041c95eae1c38742d368582c115a9b44cab not found: ID does not exist" Jul 16 20:35:26.071514 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071478 2563 scope.go:117] "RemoveContainer" containerID="4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938" Jul 16 20:35:26.071742 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071725 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938"} err="failed to get container status \"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938\": rpc error: code = NotFound desc = could not find container \"4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938\": container with ID starting with 4d8d551064433934e6f4fffa9117f1ea249d738e858dc1d5be1e209160767938 not found: ID does not exist" Jul 16 20:35:26.071786 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071742 2563 scope.go:117] "RemoveContainer" containerID="6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0" Jul 16 20:35:26.071967 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071952 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0"} err="failed to get container status \"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0\": rpc error: code = NotFound desc = could not find container \"6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0\": container with ID starting with 6882d103c149b7d75138a2892cfa143c996995043892ccf372923a919eb94ca0 not found: ID does not exist" Jul 16 20:35:26.072027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.071966 2563 scope.go:117] "RemoveContainer" containerID="46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac" Jul 16 20:35:26.072187 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.072171 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac"} err="failed to get container status \"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac\": rpc error: code = NotFound desc = could not find container \"46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac\": container with ID starting with 46a1813e2b56a0ed827d06d4d4b14bb089276313717f5bb1abe1de51e7543dac not found: ID does not exist" Jul 16 20:35:26.072228 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.072189 2563 scope.go:117] "RemoveContainer" containerID="cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2" Jul 16 20:35:26.072417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.072401 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2"} err="failed to get container status \"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2\": rpc error: code = NotFound desc = could not find container \"cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2\": container with ID starting with cb15a2e966c2e9fdf13b21aef86e292798a0b718a5f37cff0c0363787044e8c2 not found: ID does not exist" Jul 16 20:35:26.077971 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.077949 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:26.078218 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078206 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="config-reloader" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078220 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="config-reloader" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078228 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-metric" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078233 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-metric" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078240 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="alertmanager" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078245 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="alertmanager" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078251 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="init-config-reloader" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078256 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="init-config-reloader" Jul 16 20:35:26.078261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078263 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078269 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078281 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="prom-label-proxy" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078285 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="prom-label-proxy" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078293 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-web" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078298 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-web" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078306 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba1722d-9680-4dd6-acd7-eea9d4952563" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078311 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba1722d-9680-4dd6-acd7-eea9d4952563" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078316 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cad81ea-8dcc-42d0-9acc-350d834708bf" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078321 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cad81ea-8dcc-42d0-9acc-350d834708bf" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078371 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="config-reloader" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078382 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cad81ea-8dcc-42d0-9acc-350d834708bf" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078389 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078395 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba1722d-9680-4dd6-acd7-eea9d4952563" containerName="console" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078399 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="alertmanager" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078404 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-metric" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078409 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="kube-rbac-proxy-web" Jul 16 20:35:26.078477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.078414 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" containerName="prom-label-proxy" Jul 16 20:35:26.083137 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.083121 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.085871 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.085850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 20:35:26.085871 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.085869 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 20:35:26.086021 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.085916 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 20:35:26.086182 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086165 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 20:35:26.086182 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 20:35:26.086182 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 20:35:26.086182 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086207 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 20:35:26.086444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086406 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 20:35:26.086499 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.086484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-55wzw\"" Jul 16 20:35:26.091719 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.091697 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 20:35:26.097839 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.097815 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:26.114025 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.113999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-config-volume\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-config-out\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgjl\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-kube-api-access-rzgjl\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.114381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.114369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-web-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215231 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-web-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-config-volume\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-config-out\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgjl\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-kube-api-access-rzgjl\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.215687 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.215662 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.216415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.216091 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.217257 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.217229 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/487b2e15-71b0-4c72-8895-eb377017d283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.218647 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.218617 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.218746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.218644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.218746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.218699 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.219017 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.218992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-config-volume\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.219488 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.219463 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-web-config\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.219488 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.219480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.219579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.219466 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.219579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.219498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/487b2e15-71b0-4c72-8895-eb377017d283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.220101 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.220086 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/487b2e15-71b0-4c72-8895-eb377017d283-config-out\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.227237 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.227218 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgjl\" (UniqueName: \"kubernetes.io/projected/487b2e15-71b0-4c72-8895-eb377017d283-kube-api-access-rzgjl\") pod \"alertmanager-main-0\" (UID: \"487b2e15-71b0-4c72-8895-eb377017d283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.392576 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.392550 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 20:35:26.530123 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:26.530098 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 20:35:26.531816 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:35:26.531790 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487b2e15_71b0_4c72_8895_eb377017d283.slice/crio-1097fa0b64a50325e9eea903fd8e2e03c46d485c21aea102c0134c2b6aa01de8 WatchSource:0}: Error finding container 1097fa0b64a50325e9eea903fd8e2e03c46d485c21aea102c0134c2b6aa01de8: Status 404 returned error can't find the container with id 1097fa0b64a50325e9eea903fd8e2e03c46d485c21aea102c0134c2b6aa01de8 Jul 16 20:35:27.024412 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:27.024376 2563 generic.go:356] "Generic (PLEG): container finished" podID="487b2e15-71b0-4c72-8895-eb377017d283" containerID="be4103f8691f9e8acb395ea02dec9e5e0c4df848e2d96e92d3539787c856e540" exitCode=0 Jul 16 20:35:27.024555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:27.024457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerDied","Data":"be4103f8691f9e8acb395ea02dec9e5e0c4df848e2d96e92d3539787c856e540"} Jul 16 20:35:27.024555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:27.024535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"1097fa0b64a50325e9eea903fd8e2e03c46d485c21aea102c0134c2b6aa01de8"} Jul 16 20:35:27.260954 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:27.260925 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b983e88c-8af7-4d75-89fc-bb3231a7d95e" path="/var/lib/kubelet/pods/b983e88c-8af7-4d75-89fc-bb3231a7d95e/volumes" Jul 16 20:35:28.031875 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.031838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"7c5bc40bc0eb7095b616f06985c832a699733b2566295105597ddf2d03a4bedf"} Jul 16 20:35:28.032245 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.031942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"78167e3ec7714ba0fb5b86cd9bfc924a8434b5aecb9a30ba6a78cf414f167c8f"} Jul 16 20:35:28.032245 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.031984 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"df6ca447c3e17e0f9aaa88230cecd5c09aec8576e51f9627c3ae82c389ef3a90"} Jul 16 20:35:28.032245 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.032022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"d679fdec2e7ba0209e3df16df9832e0912307c0114f2b0b4ff6e43e7318f8869"} Jul 16 20:35:28.032245 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.032056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"9b3ed0f561a0e5822a3ad5692dab4583f4ca59c4d65dda59b026840f3f1c07e6"} Jul 16 20:35:28.032245 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.032091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"487b2e15-71b0-4c72-8895-eb377017d283","Type":"ContainerStarted","Data":"85d743f0a0704d74c9f1c8938aa977f4887936c7724742a08cfedd835ea53950"} Jul 16 20:35:28.056870 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.056821 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.0453752610000002 podStartE2EDuration="2.05680771s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.432449ms" isStatefulPod=false podCreationTimestamp="2026-07-16 20:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:35:28.055365165 +0000 UTC m=+151.314324605" watchObservedRunningTime="2026-07-16 20:35:28.05680771 +0000 UTC m=+151.315767159" Jul 16 20:35:28.256074 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.256038 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs"] Jul 16 20:35:28.258418 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.258402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.263438 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.263414 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 20:35:28.263569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.263460 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 20:35:28.263569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.263463 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 20:35:28.263708 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.263695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 20:35:28.264277 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.264262 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gcrm7\"" Jul 16 20:35:28.264327 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.264295 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 20:35:28.286165 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.286106 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs"] Jul 16 20:35:28.293829 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.293803 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 20:35:28.333207 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfcmn\" (UniqueName: \"kubernetes.io/projected/79638689-6b31-469b-9e9c-e68e9d7ee57f-kube-api-access-gfcmn\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333207 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-serving-certs-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333410 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333410 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333410 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333410 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-federate-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.333559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.333460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-metrics-client-ca\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.433958 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.433887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfcmn\" (UniqueName: \"kubernetes.io/projected/79638689-6b31-469b-9e9c-e68e9d7ee57f-kube-api-access-gfcmn\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434100 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.433978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-serving-certs-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434100 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434100 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434278 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434278 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434278 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-federate-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.434278 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.434221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-metrics-client-ca\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.435264 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.435214 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-serving-certs-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.435478 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.435457 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-metrics-client-ca\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.441716 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.435986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.441716 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.437615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-federate-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.441716 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.438421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-telemeter-client-tls\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.442448 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.442357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.444622 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.444596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79638689-6b31-469b-9e9c-e68e9d7ee57f-secret-telemeter-client\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.445842 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.445822 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfcmn\" (UniqueName: \"kubernetes.io/projected/79638689-6b31-469b-9e9c-e68e9d7ee57f-kube-api-access-gfcmn\") pod \"telemeter-client-6f6bb796bf-cq2qs\" (UID: \"79638689-6b31-469b-9e9c-e68e9d7ee57f\") " pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.569079 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.568735 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" Jul 16 20:35:28.732675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:28.732641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs"] Jul 16 20:35:28.734954 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:35:28.734923 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79638689_6b31_469b_9e9c_e68e9d7ee57f.slice/crio-7af0338134585ad2221ccd05b1d1e9f64289740c570a78c1cc2dbd88f7a20f11 WatchSource:0}: Error finding container 7af0338134585ad2221ccd05b1d1e9f64289740c570a78c1cc2dbd88f7a20f11: Status 404 returned error can't find the container with id 7af0338134585ad2221ccd05b1d1e9f64289740c570a78c1cc2dbd88f7a20f11 Jul 16 20:35:29.037293 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:29.037259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" event={"ID":"79638689-6b31-469b-9e9c-e68e9d7ee57f","Type":"ContainerStarted","Data":"7af0338134585ad2221ccd05b1d1e9f64289740c570a78c1cc2dbd88f7a20f11"} Jul 16 20:35:32.054779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.054739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" event={"ID":"79638689-6b31-469b-9e9c-e68e9d7ee57f","Type":"ContainerStarted","Data":"51fe29e4656943c273c9ecb156220dac504160f7ef2a7176d8905bddf3a3f281"} Jul 16 20:35:32.055158 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.054828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" event={"ID":"79638689-6b31-469b-9e9c-e68e9d7ee57f","Type":"ContainerStarted","Data":"01c30f85f3a97035d3774d869438fa7cf612caea274e488068760d7ed14cd5ba"} Jul 16 20:35:32.055158 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.054855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" event={"ID":"79638689-6b31-469b-9e9c-e68e9d7ee57f","Type":"ContainerStarted","Data":"6c71895aae4411a8a71b90e28fdea2c6220d5e454919a1106503f26d5f1bafd7"} Jul 16 20:35:32.079874 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.079828 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f6bb796bf-cq2qs" podStartSLOduration=1.6332819459999999 podStartE2EDuration="4.079813723s" totalImagesPullingTime="2.446531777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:35:32.077694939 +0000 UTC m=+155.336654414" watchObservedRunningTime="2026-07-16 20:35:32.079813723 +0000 UTC m=+155.338773172" Jul 16 20:35:32.693592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.693556 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:35:32.696948 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.696931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.707624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.707599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:35:32.743659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.743632 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:32.768851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.768822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswjg\" (UniqueName: \"kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.768953 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.768856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.768953 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.768879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.769073 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.768976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.769073 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.769031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.769136 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.769100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.769169 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.769140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.797284 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.797233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:32.869487 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869565 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869565 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswjg\" (UniqueName: \"kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869663 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869706 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.869775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.869746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.870351 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.870267 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.870351 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.870360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.870568 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.870521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.870638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.870609 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.872171 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.872136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.872353 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.872334 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:32.878989 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:32.878967 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswjg\" (UniqueName: \"kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg\") pod \"console-85cd66c755-pqcng\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:33.006931 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:33.006864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:33.136364 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:33.133943 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:35:33.137321 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:35:33.137288 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90339004_491f_418d_b5fd_d73dec1ba3d7.slice/crio-80b8db1e4d57aa3aa524ddbf98653bfa6e01ea471e1965231edc1f74fbc203cb WatchSource:0}: Error finding container 80b8db1e4d57aa3aa524ddbf98653bfa6e01ea471e1965231edc1f74fbc203cb: Status 404 returned error can't find the container with id 80b8db1e4d57aa3aa524ddbf98653bfa6e01ea471e1965231edc1f74fbc203cb Jul 16 20:35:34.066304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:34.066270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd66c755-pqcng" event={"ID":"90339004-491f-418d-b5fd-d73dec1ba3d7","Type":"ContainerStarted","Data":"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024"} Jul 16 20:35:34.066470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:34.066322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd66c755-pqcng" event={"ID":"90339004-491f-418d-b5fd-d73dec1ba3d7","Type":"ContainerStarted","Data":"80b8db1e4d57aa3aa524ddbf98653bfa6e01ea471e1965231edc1f74fbc203cb"} Jul 16 20:35:34.085289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:34.085243 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85cd66c755-pqcng" podStartSLOduration=2.085229834 podStartE2EDuration="2.085229834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:35:34.083851726 +0000 UTC m=+157.342811175" watchObservedRunningTime="2026-07-16 20:35:34.085229834 +0000 UTC m=+157.344189282" Jul 16 20:35:43.006994 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.006966 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:43.007338 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.007025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:43.011570 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.011551 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:43.105254 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.105230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:35:43.150332 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.150306 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:35:43.250454 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.250423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:43.315205 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.315128 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:35:43.372029 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:35:43.372000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:08.176887 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.176829 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f66575c47-h2glv" podUID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" containerName="console" containerID="cri-o://726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889" gracePeriod=15 Jul 16 20:36:08.416287 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.416264 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:36:08.564662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564590 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.564662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564629 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.564662 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564653 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.564880 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564705 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.564880 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564728 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm8gp\" (UniqueName: \"kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.565027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564896 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.565027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.564974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca\") pod \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\" (UID: \"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d\") " Jul 16 20:36:08.565200 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565149 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:36:08.565200 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565163 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:36:08.565200 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565152 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config" (OuterVolumeSpecName: "console-config") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:36:08.565577 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565551 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca" (OuterVolumeSpecName: "service-ca") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:36:08.565683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565551 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-trusted-ca-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.565683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565603 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.565683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.565618 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-oauth-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.566958 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.566929 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp" (OuterVolumeSpecName: "kube-api-access-gm8gp") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "kube-api-access-gm8gp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:36:08.566958 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.566946 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:36:08.567172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.567144 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" (UID: "00691265-fe4d-4aa3-a2ed-ccaa50d6a77d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:36:08.666329 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.666301 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.666329 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.666324 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.666329 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.666334 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-console-oauth-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:08.666520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:08.666343 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm8gp\" (UniqueName: \"kubernetes.io/projected/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d-kube-api-access-gm8gp\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:36:09.202672 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.202635 2563 generic.go:356] "Generic (PLEG): container finished" podID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" containerID="726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889" exitCode=0 Jul 16 20:36:09.203179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.202679 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f66575c47-h2glv" Jul 16 20:36:09.203179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.202685 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66575c47-h2glv" event={"ID":"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d","Type":"ContainerDied","Data":"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889"} Jul 16 20:36:09.203179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.202819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f66575c47-h2glv" event={"ID":"00691265-fe4d-4aa3-a2ed-ccaa50d6a77d","Type":"ContainerDied","Data":"f1e7a01df3598ab6b3df58c433b360c6e84de43ab48c5cfbb8553adf09265796"} Jul 16 20:36:09.203179 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.202842 2563 scope.go:117] "RemoveContainer" containerID="726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889" Jul 16 20:36:09.211416 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.211398 2563 scope.go:117] "RemoveContainer" containerID="726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889" Jul 16 20:36:09.211659 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:36:09.211641 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889\": container with ID starting with 726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889 not found: ID does not exist" containerID="726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889" Jul 16 20:36:09.211721 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.211668 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889"} err="failed to get container status \"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889\": rpc error: code = NotFound desc = could not find container \"726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889\": container with ID starting with 726d01e5239de7b352a9a73bc0399f395dfaa817507509652a90b4f658637889 not found: ID does not exist" Jul 16 20:36:09.223470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.223447 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:36:09.226856 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.226832 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f66575c47-h2glv"] Jul 16 20:36:09.259041 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:09.259018 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" path="/var/lib/kubelet/pods/00691265-fe4d-4aa3-a2ed-ccaa50d6a77d/volumes" Jul 16 20:36:25.650948 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:25.650891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:25.701159 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:25.701131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:38.439775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:38.439737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:38.492451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:38.492423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:42.487782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.487745 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:36:42.488162 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.488073 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" containerName="console" Jul 16 20:36:42.488162 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.488084 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" containerName="console" Jul 16 20:36:42.488162 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.488141 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00691265-fe4d-4aa3-a2ed-ccaa50d6a77d" containerName="console" Jul 16 20:36:42.491173 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.491155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.501768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.501746 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:36:42.575862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.575830 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:42.622656 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ws7\" (UniqueName: \"kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.622848 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.622823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.676116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.676089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:42.723342 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ws7\" (UniqueName: \"kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723444 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.723697 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.723481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.724154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.724128 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.724294 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.724277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.724382 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.724361 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.724478 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.724454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.726000 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.725971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.726116 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.726096 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.731018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.730998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ws7\" (UniqueName: \"kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7\") pod \"console-59fd7dd674-lhkj7\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.800102 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.800044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:42.942517 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:42.942486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:36:42.945525 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:36:42.945495 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7a18ad_7909_4682_ac9e_7c2201288c78.slice/crio-04d776de6daf27f298ab7e3039fe0e400e945e6aec428ec3497d8b316bde8e84 WatchSource:0}: Error finding container 04d776de6daf27f298ab7e3039fe0e400e945e6aec428ec3497d8b316bde8e84: Status 404 returned error can't find the container with id 04d776de6daf27f298ab7e3039fe0e400e945e6aec428ec3497d8b316bde8e84 Jul 16 20:36:43.335403 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:43.335364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd7dd674-lhkj7" event={"ID":"2e7a18ad-7909-4682-ac9e-7c2201288c78","Type":"ContainerStarted","Data":"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c"} Jul 16 20:36:43.335610 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:43.335417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd7dd674-lhkj7" event={"ID":"2e7a18ad-7909-4682-ac9e-7c2201288c78","Type":"ContainerStarted","Data":"04d776de6daf27f298ab7e3039fe0e400e945e6aec428ec3497d8b316bde8e84"} Jul 16 20:36:43.354755 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:43.354005 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59fd7dd674-lhkj7" podStartSLOduration=1.35398855 podStartE2EDuration="1.35398855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:36:43.353105638 +0000 UTC m=+226.612065084" watchObservedRunningTime="2026-07-16 20:36:43.35398855 +0000 UTC m=+226.612948002" Jul 16 20:36:50.480804 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:50.480743 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:50.531098 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:50.531069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:52.800608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:52.800570 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:52.801055 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:52.800662 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:52.805291 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:52.805272 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:53.379718 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:53.379693 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:36:53.425992 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:53.425960 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:36:53.527492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:53.527465 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:53.581896 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:53.581868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:36:53.671727 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:36:53.671702 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:00.648210 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:00.648178 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:00.749227 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:00.749191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:00.804309 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:00.804276 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:18.448447 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.448370 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85cd66c755-pqcng" podUID="90339004-491f-418d-b5fd-d73dec1ba3d7" containerName="console" containerID="cri-o://43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024" gracePeriod=15 Jul 16 20:37:18.685285 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.685264 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:37:18.720400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720391 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswjg\" (UniqueName: \"kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720487 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720559 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720515 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720669 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720559 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720669 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720582 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.720855 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720776 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config" (OuterVolumeSpecName: "console-config") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:37:18.720939 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.720854 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:37:18.721083 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.721058 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:37:18.721393 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.721362 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:37:18.722768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.722736 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg" (OuterVolumeSpecName: "kube-api-access-wswjg") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "kube-api-access-wswjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:37:18.722840 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.722763 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:37:18.821696 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821676 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config\") pod \"90339004-491f-418d-b5fd-d73dec1ba3d7\" (UID: \"90339004-491f-418d-b5fd-d73dec1ba3d7\") " Jul 16 20:37:18.821875 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821863 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswjg\" (UniqueName: \"kubernetes.io/projected/90339004-491f-418d-b5fd-d73dec1ba3d7-kube-api-access-wswjg\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.821941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821878 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-oauth-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.821941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821887 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.821941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821895 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.821941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821923 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-trusted-ca-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.821941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.821947 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90339004-491f-418d-b5fd-d73dec1ba3d7-console-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:18.823638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.823618 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90339004-491f-418d-b5fd-d73dec1ba3d7" (UID: "90339004-491f-418d-b5fd-d73dec1ba3d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:37:18.923250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:18.923221 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90339004-491f-418d-b5fd-d73dec1ba3d7-console-oauth-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:19.473852 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.473814 2563 generic.go:356] "Generic (PLEG): container finished" podID="90339004-491f-418d-b5fd-d73dec1ba3d7" containerID="43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024" exitCode=0 Jul 16 20:37:19.474304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.473853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd66c755-pqcng" event={"ID":"90339004-491f-418d-b5fd-d73dec1ba3d7","Type":"ContainerDied","Data":"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024"} Jul 16 20:37:19.474304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.473865 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cd66c755-pqcng" Jul 16 20:37:19.474304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.473928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cd66c755-pqcng" event={"ID":"90339004-491f-418d-b5fd-d73dec1ba3d7","Type":"ContainerDied","Data":"80b8db1e4d57aa3aa524ddbf98653bfa6e01ea471e1965231edc1f74fbc203cb"} Jul 16 20:37:19.474304 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.473952 2563 scope.go:117] "RemoveContainer" containerID="43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024" Jul 16 20:37:19.482378 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.482363 2563 scope.go:117] "RemoveContainer" containerID="43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024" Jul 16 20:37:19.482635 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:37:19.482616 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024\": container with ID starting with 43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024 not found: ID does not exist" containerID="43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024" Jul 16 20:37:19.482685 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.482654 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024"} err="failed to get container status \"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024\": rpc error: code = NotFound desc = could not find container \"43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024\": container with ID starting with 43c893882715b7cf9e9e04c7cd4478b947885b93504102b6f236d0d752b77024 not found: ID does not exist" Jul 16 20:37:19.489763 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.489741 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:37:19.492032 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:19.492013 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85cd66c755-pqcng"] Jul 16 20:37:21.259093 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:21.259058 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90339004-491f-418d-b5fd-d73dec1ba3d7" path="/var/lib/kubelet/pods/90339004-491f-418d-b5fd-d73dec1ba3d7/volumes" Jul 16 20:37:30.269542 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.269500 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:30.990054 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.990012 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd"] Jul 16 20:37:30.990370 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.990357 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90339004-491f-418d-b5fd-d73dec1ba3d7" containerName="console" Jul 16 20:37:30.990412 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.990372 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90339004-491f-418d-b5fd-d73dec1ba3d7" containerName="console" Jul 16 20:37:30.990453 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.990443 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90339004-491f-418d-b5fd-d73dec1ba3d7" containerName="console" Jul 16 20:37:30.995002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.994983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:30.997540 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.997518 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9k47x\"" Jul 16 20:37:30.997663 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.997523 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 20:37:30.998493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:30.998478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 20:37:31.002515 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.002497 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd"] Jul 16 20:37:31.124009 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.123966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.124197 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.124024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvpqv\" (UniqueName: \"kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.124197 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.124063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.225275 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.225241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.225415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.225288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvpqv\" (UniqueName: \"kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.225415 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.225319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.225652 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.225632 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.225688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.225670 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.233608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.233582 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvpqv\" (UniqueName: \"kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.304986 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.304926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:31.443396 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.443367 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd"] Jul 16 20:37:31.446452 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:37:31.446427 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff619bb_9e0e_47bb_8724_ddc435ca080b.slice/crio-7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a WatchSource:0}: Error finding container 7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a: Status 404 returned error can't find the container with id 7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a Jul 16 20:37:31.527939 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:31.527881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" event={"ID":"dff619bb-9e0e-47bb-8724-ddc435ca080b","Type":"ContainerStarted","Data":"7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a"} Jul 16 20:37:33.991299 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:33.991266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:37.553517 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:37.553487 2563 generic.go:356] "Generic (PLEG): container finished" podID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerID="701b47ae1ce034f3143725b290529c15c929e77dd1dbef7cf56df3ac9f0b61a0" exitCode=0 Jul 16 20:37:37.553950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:37.553577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" event={"ID":"dff619bb-9e0e-47bb-8724-ddc435ca080b","Type":"ContainerDied","Data":"701b47ae1ce034f3143725b290529c15c929e77dd1dbef7cf56df3ac9f0b61a0"} Jul 16 20:37:40.567324 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:40.567284 2563 generic.go:356] "Generic (PLEG): container finished" podID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerID="3e5508bb700c3654a2b46beb30ac64e2462249e448d1f0895ddcfc3180eb2706" exitCode=0 Jul 16 20:37:40.567694 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:40.567358 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" event={"ID":"dff619bb-9e0e-47bb-8724-ddc435ca080b","Type":"ContainerDied","Data":"3e5508bb700c3654a2b46beb30ac64e2462249e448d1f0895ddcfc3180eb2706"} Jul 16 20:37:48.603414 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:48.603374 2563 generic.go:356] "Generic (PLEG): container finished" podID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerID="a7ee45cfb97a7b06b4b4b4885ba6cc351da3a256971a1bc6bec4e266659db05d" exitCode=0 Jul 16 20:37:48.603776 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:48.603494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" event={"ID":"dff619bb-9e0e-47bb-8724-ddc435ca080b","Type":"ContainerDied","Data":"a7ee45cfb97a7b06b4b4b4885ba6cc351da3a256971a1bc6bec4e266659db05d"} Jul 16 20:37:49.732339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.732318 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:49.896758 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.896732 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvpqv\" (UniqueName: \"kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv\") pod \"dff619bb-9e0e-47bb-8724-ddc435ca080b\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " Jul 16 20:37:49.896928 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.896805 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util\") pod \"dff619bb-9e0e-47bb-8724-ddc435ca080b\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " Jul 16 20:37:49.896928 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.896825 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle\") pod \"dff619bb-9e0e-47bb-8724-ddc435ca080b\" (UID: \"dff619bb-9e0e-47bb-8724-ddc435ca080b\") " Jul 16 20:37:49.897517 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.897489 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle" (OuterVolumeSpecName: "bundle") pod "dff619bb-9e0e-47bb-8724-ddc435ca080b" (UID: "dff619bb-9e0e-47bb-8724-ddc435ca080b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:37:49.898986 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.898964 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv" (OuterVolumeSpecName: "kube-api-access-kvpqv") pod "dff619bb-9e0e-47bb-8724-ddc435ca080b" (UID: "dff619bb-9e0e-47bb-8724-ddc435ca080b"). InnerVolumeSpecName "kube-api-access-kvpqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:37:49.903543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.903514 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util" (OuterVolumeSpecName: "util") pod "dff619bb-9e0e-47bb-8724-ddc435ca080b" (UID: "dff619bb-9e0e-47bb-8724-ddc435ca080b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:37:49.997860 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.997835 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:49.997860 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.997855 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dff619bb-9e0e-47bb-8724-ddc435ca080b-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:49.998015 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:49.997865 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvpqv\" (UniqueName: \"kubernetes.io/projected/dff619bb-9e0e-47bb-8724-ddc435ca080b-kube-api-access-kvpqv\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:37:50.612510 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:50.612482 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" Jul 16 20:37:50.612683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:50.612483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cgzgd" event={"ID":"dff619bb-9e0e-47bb-8724-ddc435ca080b","Type":"ContainerDied","Data":"7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a"} Jul 16 20:37:50.612683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:50.612596 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7325a75b0baf0c7b0cbb277345f6b50b02dce6fbcf2fa9ea47c59d064159769a" Jul 16 20:37:51.957550 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:51.957508 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:52.756284 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:52.756247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:53.919199 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919164 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t"] Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919477 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="extract" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919488 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="extract" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919499 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="util" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919504 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="util" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919515 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="pull" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919521 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="pull" Jul 16 20:37:53.919584 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.919573 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dff619bb-9e0e-47bb-8724-ddc435ca080b" containerName="extract" Jul 16 20:37:53.955508 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.955485 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t"] Jul 16 20:37:53.955659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.955570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:53.959030 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.959005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 20:37:53.959170 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.959033 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:37:53.959170 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:53.959013 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cw75j\"" Jul 16 20:37:54.131883 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.131846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5vhw\" (UniqueName: \"kubernetes.io/projected/9f6a7124-7ddd-4970-8409-d72a426426e2-kube-api-access-l5vhw\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.132076 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.131962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6a7124-7ddd-4970-8409-d72a426426e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.233322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.233260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6a7124-7ddd-4970-8409-d72a426426e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.233322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.233312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5vhw\" (UniqueName: \"kubernetes.io/projected/9f6a7124-7ddd-4970-8409-d72a426426e2-kube-api-access-l5vhw\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.233649 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.233631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6a7124-7ddd-4970-8409-d72a426426e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.242258 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.242238 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5vhw\" (UniqueName: \"kubernetes.io/projected/9f6a7124-7ddd-4970-8409-d72a426426e2-kube-api-access-l5vhw\") pod \"cert-manager-operator-controller-manager-55c444bf86-mfj5t\" (UID: \"9f6a7124-7ddd-4970-8409-d72a426426e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.264420 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.264399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" Jul 16 20:37:54.413803 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.413771 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t"] Jul 16 20:37:54.418311 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:37:54.418280 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6a7124_7ddd_4970_8409_d72a426426e2.slice/crio-4982c56d3ad9152832e59dd6fbbcd87b1a6d93ebec7d13cad6033a7444a667ba WatchSource:0}: Error finding container 4982c56d3ad9152832e59dd6fbbcd87b1a6d93ebec7d13cad6033a7444a667ba: Status 404 returned error can't find the container with id 4982c56d3ad9152832e59dd6fbbcd87b1a6d93ebec7d13cad6033a7444a667ba Jul 16 20:37:54.633938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:54.633892 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" event={"ID":"9f6a7124-7ddd-4970-8409-d72a426426e2","Type":"ContainerStarted","Data":"4982c56d3ad9152832e59dd6fbbcd87b1a6d93ebec7d13cad6033a7444a667ba"} Jul 16 20:37:55.593917 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:55.593878 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:55.694626 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:55.694590 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:57.118260 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.118180 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:37:57.120170 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.120146 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:37:57.121701 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.121683 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 20:37:57.514256 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.514207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.614174 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.648283 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x2fj"] Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.671320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.671332 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" event={"ID":"9f6a7124-7ddd-4970-8409-d72a426426e2","Type":"ContainerStarted","Data":"c31f63b9ce96aaeb923cc9750930a2f79d7efba91d1de6627690201ec2c4e57d"} Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.671382 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x2fj"] Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.674235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bzwjh\"" Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.674342 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.674342 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 20:37:57.739057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.677296 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mfj5t" podStartSLOduration=2.430105951 podStartE2EDuration="4.677284571s" totalImagesPullingTime="2.24717862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:37:57.675649784 +0000 UTC m=+300.934609234" watchObservedRunningTime="2026-07-16 20:37:57.677284571 +0000 UTC m=+300.936244021" Jul 16 20:37:57.761263 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.761227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.761409 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.761266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv9cn\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-kube-api-access-cv9cn\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.862300 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.862219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.862300 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.862258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv9cn\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-kube-api-access-cv9cn\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.871676 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.871645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.871800 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.871784 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv9cn\" (UniqueName: \"kubernetes.io/projected/e0b49889-b555-433e-91e8-3bacb3ad1af7-kube-api-access-cv9cn\") pod \"cert-manager-webhook-6486ffd997-9x2fj\" (UID: \"e0b49889-b555-433e-91e8-3bacb3ad1af7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:57.989154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:57.989126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:37:58.067779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.067741 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:58.153103 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.153078 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9x2fj"] Jul 16 20:37:58.155734 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:37:58.155706 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0b49889_b555_433e_91e8_3bacb3ad1af7.slice/crio-70b4e194215f297387019393a1bf5cfe7a3def76f58c2b95af58add82a258800 WatchSource:0}: Error finding container 70b4e194215f297387019393a1bf5cfe7a3def76f58c2b95af58add82a258800: Status 404 returned error can't find the container with id 70b4e194215f297387019393a1bf5cfe7a3def76f58c2b95af58add82a258800 Jul 16 20:37:58.214567 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.214532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:37:58.526986 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.526912 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz"] Jul 16 20:37:58.560520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.560494 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz"] Jul 16 20:37:58.560654 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.560587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.565548 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.565520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 20:37:58.565548 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.565520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 20:37:58.566246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.566224 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9k47x\"" Jul 16 20:37:58.567516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.567428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.567516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.567482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.567743 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.567669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw667\" (UniqueName: \"kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.654800 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.654765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" event={"ID":"e0b49889-b555-433e-91e8-3bacb3ad1af7","Type":"ContainerStarted","Data":"70b4e194215f297387019393a1bf5cfe7a3def76f58c2b95af58add82a258800"} Jul 16 20:37:58.668492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.668468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.668570 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.668497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.668624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.668567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw667\" (UniqueName: \"kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.668919 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.668884 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.668966 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.668925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.680242 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.680223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw667\" (UniqueName: \"kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.869819 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.869732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:37:58.994153 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:58.994122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz"] Jul 16 20:37:58.996029 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:37:58.995999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a073ee_d55e_4165_835e_0832bf90c63d.slice/crio-b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91 WatchSource:0}: Error finding container b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91: Status 404 returned error can't find the container with id b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91 Jul 16 20:37:59.661007 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:59.660974 2563 generic.go:356] "Generic (PLEG): container finished" podID="87a073ee-d55e-4165-835e-0832bf90c63d" containerID="2ed47720637add9cf3fd89e7f5c37299205698d888cba3d6e650d9c66b46be31" exitCode=0 Jul 16 20:37:59.661462 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:59.661044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerDied","Data":"2ed47720637add9cf3fd89e7f5c37299205698d888cba3d6e650d9c66b46be31"} Jul 16 20:37:59.661462 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:59.661089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerStarted","Data":"b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91"} Jul 16 20:37:59.662264 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:59.662234 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:37:59.877672 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:37:59.877626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:00.105165 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.105077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:00.162290 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.162261 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb"] Jul 16 20:38:00.164950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.164923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.167712 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.167683 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rm9pm\"" Jul 16 20:38:00.174930 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.174880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb"] Jul 16 20:38:00.178220 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.178199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.178361 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.178249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9qqn\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-kube-api-access-l9qqn\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.257198 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.257164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:00.279529 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.279498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.279659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.279557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9qqn\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-kube-api-access-l9qqn\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.290243 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.290200 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9qqn\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-kube-api-access-l9qqn\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.290381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.290358 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1cdeab86-af49-470c-8058-921f66ad2878-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rq7jb\" (UID: \"1cdeab86-af49-470c-8058-921f66ad2878\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.364742 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.364673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:00.476934 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.476883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" Jul 16 20:38:00.656280 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.656250 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb"] Jul 16 20:38:00.660248 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:38:00.660218 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cdeab86_af49_470c_8058_921f66ad2878.slice/crio-dd610b1b3a15feeab1e03afb6ebccc3585904d17e6a4bfec9473d871c17213d3 WatchSource:0}: Error finding container dd610b1b3a15feeab1e03afb6ebccc3585904d17e6a4bfec9473d871c17213d3: Status 404 returned error can't find the container with id dd610b1b3a15feeab1e03afb6ebccc3585904d17e6a4bfec9473d871c17213d3 Jul 16 20:38:00.669675 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:00.669649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" event={"ID":"1cdeab86-af49-470c-8058-921f66ad2878","Type":"ContainerStarted","Data":"dd610b1b3a15feeab1e03afb6ebccc3585904d17e6a4bfec9473d871c17213d3"} Jul 16 20:38:02.575946 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.575915 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:02.678205 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.678177 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:02.683019 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.682962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerStarted","Data":"2a52bdc65f64b803791bfadecdff084d0235c6dfef2931afa82b91158c9a3350"} Jul 16 20:38:02.684261 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.684234 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" event={"ID":"1cdeab86-af49-470c-8058-921f66ad2878","Type":"ContainerStarted","Data":"d05d76d8df5b77f8647b7ac5198860ffb5b5de9645473756d65079f5e68a1693"} Jul 16 20:38:02.685749 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.685711 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" event={"ID":"e0b49889-b555-433e-91e8-3bacb3ad1af7","Type":"ContainerStarted","Data":"7121cbc2f2de480b90e4c2f0ea66b8fe1616766bda1094c0827a782afc8fe007"} Jul 16 20:38:02.685945 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.685846 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:38:02.716427 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:02.716382 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rq7jb" podStartSLOduration=0.84158453 podStartE2EDuration="2.716368522s" totalImagesPullingTime="1.874783992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:38:02.715312128 +0000 UTC m=+305.974271577" watchObservedRunningTime="2026-07-16 20:38:02.716368522 +0000 UTC m=+305.975327970" Jul 16 20:38:03.692373 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:03.692335 2563 generic.go:356] "Generic (PLEG): container finished" podID="87a073ee-d55e-4165-835e-0832bf90c63d" containerID="2a52bdc65f64b803791bfadecdff084d0235c6dfef2931afa82b91158c9a3350" exitCode=0 Jul 16 20:38:03.692809 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:03.692416 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerDied","Data":"2a52bdc65f64b803791bfadecdff084d0235c6dfef2931afa82b91158c9a3350"} Jul 16 20:38:03.710289 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:03.710242 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" podStartSLOduration=2.361607404 podStartE2EDuration="6.710223914s" totalImagesPullingTime="4.34861651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:38:02.749004845 +0000 UTC m=+306.007964296" watchObservedRunningTime="2026-07-16 20:38:03.710223914 +0000 UTC m=+306.969183365" Jul 16 20:38:04.698360 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:04.698327 2563 generic.go:356] "Generic (PLEG): container finished" podID="87a073ee-d55e-4165-835e-0832bf90c63d" containerID="b8578769bdeeeb3998dd6433c9027899a8e106d4ec15db46b79928a1226ec5af" exitCode=0 Jul 16 20:38:04.698788 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:04.698395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerDied","Data":"b8578769bdeeeb3998dd6433c9027899a8e106d4ec15db46b79928a1226ec5af"} Jul 16 20:38:05.832165 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.832144 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:38:05.926381 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.926354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle\") pod \"87a073ee-d55e-4165-835e-0832bf90c63d\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " Jul 16 20:38:05.926566 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.926420 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util\") pod \"87a073ee-d55e-4165-835e-0832bf90c63d\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " Jul 16 20:38:05.926566 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.926454 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw667\" (UniqueName: \"kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667\") pod \"87a073ee-d55e-4165-835e-0832bf90c63d\" (UID: \"87a073ee-d55e-4165-835e-0832bf90c63d\") " Jul 16 20:38:05.926745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.926708 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle" (OuterVolumeSpecName: "bundle") pod "87a073ee-d55e-4165-835e-0832bf90c63d" (UID: "87a073ee-d55e-4165-835e-0832bf90c63d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:38:05.928669 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.928639 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667" (OuterVolumeSpecName: "kube-api-access-zw667") pod "87a073ee-d55e-4165-835e-0832bf90c63d" (UID: "87a073ee-d55e-4165-835e-0832bf90c63d"). InnerVolumeSpecName "kube-api-access-zw667". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:38:05.932722 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:05.932698 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util" (OuterVolumeSpecName: "util") pod "87a073ee-d55e-4165-835e-0832bf90c63d" (UID: "87a073ee-d55e-4165-835e-0832bf90c63d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:38:06.027171 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.027112 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:06.027171 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.027131 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87a073ee-d55e-4165-835e-0832bf90c63d-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:06.027171 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.027142 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw667\" (UniqueName: \"kubernetes.io/projected/87a073ee-d55e-4165-835e-0832bf90c63d-kube-api-access-zw667\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:06.708645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.708609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" event={"ID":"87a073ee-d55e-4165-835e-0832bf90c63d","Type":"ContainerDied","Data":"b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91"} Jul 16 20:38:06.708645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.708630 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fb2nwz" Jul 16 20:38:06.708843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:06.708662 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b384196c50f2f9e5a36435e13f04c46a5b877934cc6dbfab6e87f75e11201d91" Jul 16 20:38:07.071192 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:07.071106 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:08.200012 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.199980 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5zwvm"] Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200310 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="util" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200322 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="util" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200331 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="pull" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200337 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="pull" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200349 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="extract" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200354 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="extract" Jul 16 20:38:08.200408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.200409 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a073ee-d55e-4165-835e-0832bf90c63d" containerName="extract" Jul 16 20:38:08.202569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.202552 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.205082 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.205062 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zbtzj\"" Jul 16 20:38:08.212540 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.212516 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5zwvm"] Jul 16 20:38:08.245318 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.245287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bd86\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-kube-api-access-8bd86\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.245421 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.245336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-bound-sa-token\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.345802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.345774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bd86\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-kube-api-access-8bd86\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.345938 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.345829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-bound-sa-token\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.355033 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.355014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bd86\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-kube-api-access-8bd86\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.355113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.355040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7ff454b-f1a9-456c-9400-5e3b13a8b343-bound-sa-token\") pod \"cert-manager-55b4d954d5-5zwvm\" (UID: \"d7ff454b-f1a9-456c-9400-5e3b13a8b343\") " pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.511676 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.511612 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5zwvm" Jul 16 20:38:08.637279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.637211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5zwvm"] Jul 16 20:38:08.639383 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:38:08.639355 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7ff454b_f1a9_456c_9400_5e3b13a8b343.slice/crio-5ccc3eb4e2db2add5b8b651d33d9f02398356cf93e02e882a835a21628b299ab WatchSource:0}: Error finding container 5ccc3eb4e2db2add5b8b651d33d9f02398356cf93e02e882a835a21628b299ab: Status 404 returned error can't find the container with id 5ccc3eb4e2db2add5b8b651d33d9f02398356cf93e02e882a835a21628b299ab Jul 16 20:38:08.695246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.695207 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9x2fj" Jul 16 20:38:08.719268 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.719238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5zwvm" event={"ID":"d7ff454b-f1a9-456c-9400-5e3b13a8b343","Type":"ContainerStarted","Data":"008a0e338719a423ba9c2b04115faf82f8224134209cf72bc251c2841264015b"} Jul 16 20:38:08.719402 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.719277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5zwvm" event={"ID":"d7ff454b-f1a9-456c-9400-5e3b13a8b343","Type":"ContainerStarted","Data":"5ccc3eb4e2db2add5b8b651d33d9f02398356cf93e02e882a835a21628b299ab"} Jul 16 20:38:08.737070 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.737004 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5zwvm" podStartSLOduration=0.736984197 podStartE2EDuration="736.984197ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:38:08.735132489 +0000 UTC m=+311.994091939" watchObservedRunningTime="2026-07-16 20:38:08.736984197 +0000 UTC m=+311.995943648" Jul 16 20:38:08.831349 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:08.831253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:10.068882 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:10.068854 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:10.193592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:10.193562 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:11.676735 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.676701 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt"] Jul 16 20:38:11.679154 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.679138 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.681859 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.681831 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 20:38:11.682004 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.681893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 20:38:11.682776 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.682757 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f9xcc\"" Jul 16 20:38:11.688817 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.688797 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt"] Jul 16 20:38:11.773883 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.773852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwg64\" (UniqueName: \"kubernetes.io/projected/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-kube-api-access-xwg64\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.774069 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.773975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.875184 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.875137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.875356 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.875210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwg64\" (UniqueName: \"kubernetes.io/projected/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-kube-api-access-xwg64\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.875542 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.875522 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.884241 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.884215 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwg64\" (UniqueName: \"kubernetes.io/projected/36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9-kube-api-access-xwg64\") pod \"openshift-lws-operator-fd8ccff4c-9r8wt\" (UID: \"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:11.988973 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:11.988877 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" Jul 16 20:38:12.117964 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:12.117941 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt"] Jul 16 20:38:12.120075 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:38:12.120049 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e43a5e_5bb7_401a_b4c7_aca5a6aa59f9.slice/crio-ae0e299c086d4629213a0bd78ded3b5e8654788a0192203b7e66f8aed7ea602e WatchSource:0}: Error finding container ae0e299c086d4629213a0bd78ded3b5e8654788a0192203b7e66f8aed7ea602e: Status 404 returned error can't find the container with id ae0e299c086d4629213a0bd78ded3b5e8654788a0192203b7e66f8aed7ea602e Jul 16 20:38:12.738706 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:12.738668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" event={"ID":"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9","Type":"ContainerStarted","Data":"ae0e299c086d4629213a0bd78ded3b5e8654788a0192203b7e66f8aed7ea602e"} Jul 16 20:38:14.749749 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:14.749712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" event={"ID":"36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9","Type":"ContainerStarted","Data":"cf704feb0e549e07c785ca3a43cdd6ea87c81bf8e02416907ca2f6d1905af8cb"} Jul 16 20:38:14.768024 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:14.767970 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9r8wt" podStartSLOduration=2.062383323 podStartE2EDuration="3.767954368s" totalImagesPullingTime="1.705571045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:38:14.767408142 +0000 UTC m=+318.026367592" watchObservedRunningTime="2026-07-16 20:38:14.767954368 +0000 UTC m=+318.026913817" Jul 16 20:38:15.538045 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:15.538009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:15.640962 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:15.640934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:17.307163 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.307125 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g"] Jul 16 20:38:17.309746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.309731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.312112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.312088 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 20:38:17.312223 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.312191 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 20:38:17.313046 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.313026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9k47x\"" Jul 16 20:38:17.318014 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.317993 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g"] Jul 16 20:38:17.425892 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.425858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.425892 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.425897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gdrj\" (UniqueName: \"kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.426140 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.425986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.527280 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.527247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.527442 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.527289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gdrj\" (UniqueName: \"kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.527442 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.527311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.527715 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.527700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.527752 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.527702 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.535768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.535740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gdrj\" (UniqueName: \"kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.598836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.598761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:17.619859 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.619830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:17.749682 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.749658 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g"] Jul 16 20:38:17.752007 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:38:17.751980 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca437ab_8498_47b8_b553_31984cf41a6e.slice/crio-d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273 WatchSource:0}: Error finding container d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273: Status 404 returned error can't find the container with id d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273 Jul 16 20:38:17.765790 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:17.765766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" event={"ID":"7ca437ab-8498-47b8-b553-31984cf41a6e","Type":"ContainerStarted","Data":"d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273"} Jul 16 20:38:18.771162 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:18.771126 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerID="ce388fe06a0fde9d7b52ab4b62760522540ff9ed0bb7b39f8b7201bf4335dfe4" exitCode=0 Jul 16 20:38:18.771556 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:18.771170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" event={"ID":"7ca437ab-8498-47b8-b553-31984cf41a6e","Type":"ContainerDied","Data":"ce388fe06a0fde9d7b52ab4b62760522540ff9ed0bb7b39f8b7201bf4335dfe4"} Jul 16 20:38:19.777873 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:19.777787 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerID="9b0d87294f4c5e1906c821572ca3d850fbe9962e442e16415a085400c0e0db49" exitCode=0 Jul 16 20:38:19.778256 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:19.777860 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" event={"ID":"7ca437ab-8498-47b8-b553-31984cf41a6e","Type":"ContainerDied","Data":"9b0d87294f4c5e1906c821572ca3d850fbe9962e442e16415a085400c0e0db49"} Jul 16 20:38:20.784198 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:20.784165 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerID="b22a554ca87d3b763c68e7ddffb9642c31a3cf0c267301f7b766bd1d1eb3532e" exitCode=0 Jul 16 20:38:20.784579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:20.784256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" event={"ID":"7ca437ab-8498-47b8-b553-31984cf41a6e","Type":"ContainerDied","Data":"b22a554ca87d3b763c68e7ddffb9642c31a3cf0c267301f7b766bd1d1eb3532e"} Jul 16 20:38:21.913896 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.913867 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:21.964965 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.964933 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle\") pod \"7ca437ab-8498-47b8-b553-31984cf41a6e\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " Jul 16 20:38:21.964965 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.964974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util\") pod \"7ca437ab-8498-47b8-b553-31984cf41a6e\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " Jul 16 20:38:21.965188 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.965027 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gdrj\" (UniqueName: \"kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj\") pod \"7ca437ab-8498-47b8-b553-31984cf41a6e\" (UID: \"7ca437ab-8498-47b8-b553-31984cf41a6e\") " Jul 16 20:38:21.965679 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.965650 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle" (OuterVolumeSpecName: "bundle") pod "7ca437ab-8498-47b8-b553-31984cf41a6e" (UID: "7ca437ab-8498-47b8-b553-31984cf41a6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:38:21.967224 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.967189 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj" (OuterVolumeSpecName: "kube-api-access-2gdrj") pod "7ca437ab-8498-47b8-b553-31984cf41a6e" (UID: "7ca437ab-8498-47b8-b553-31984cf41a6e"). InnerVolumeSpecName "kube-api-access-2gdrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:38:21.970371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:21.970335 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util" (OuterVolumeSpecName: "util") pod "7ca437ab-8498-47b8-b553-31984cf41a6e" (UID: "7ca437ab-8498-47b8-b553-31984cf41a6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:38:22.066027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.065946 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:22.066027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.065975 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca437ab-8498-47b8-b553-31984cf41a6e-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:22.066027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.065988 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gdrj\" (UniqueName: \"kubernetes.io/projected/7ca437ab-8498-47b8-b553-31984cf41a6e-kube-api-access-2gdrj\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:38:22.795923 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.795866 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" Jul 16 20:38:22.795923 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.795865 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj6w9g" event={"ID":"7ca437ab-8498-47b8-b553-31984cf41a6e","Type":"ContainerDied","Data":"d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273"} Jul 16 20:38:22.796127 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:22.795961 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9c5762c7eabca08d37d3361970f24671c3222d25dc82c94d9eb1bbc2fce7273" Jul 16 20:38:26.829178 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:26.829145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:26.914885 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:26.914850 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:29.221466 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:29.221435 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:29.320606 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:29.320573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:29.847592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:29.847558 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.081834 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.081801 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.177222 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.177192 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.237782 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.237752 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj"] Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238099 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="util" Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238111 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="util" Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238123 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="pull" Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238130 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="pull" Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238150 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="extract" Jul 16 20:38:30.238176 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238156 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="extract" Jul 16 20:38:30.238368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.238207 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca437ab-8498-47b8-b553-31984cf41a6e" containerName="extract" Jul 16 20:38:30.250513 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.250489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.253714 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.253693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 20:38:30.253714 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.253707 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 20:38:30.254750 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.254734 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 20:38:30.255040 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.255025 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qrv96\"" Jul 16 20:38:30.257023 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.256619 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 20:38:30.271891 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.271863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj"] Jul 16 20:38:30.341400 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.341373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-tmp\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.341533 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.341411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-manifests\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.341533 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.341439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.341533 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.341519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gchhf\" (UniqueName: \"kubernetes.io/projected/83cafe49-3f0d-4e04-bf2f-09c5965ef686-kube-api-access-gchhf\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.341632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.341545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442012 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.441932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442012 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gchhf\" (UniqueName: \"kubernetes.io/projected/83cafe49-3f0d-4e04-bf2f-09c5965ef686-kube-api-access-gchhf\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442253 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442253 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-tmp\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442253 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-manifests\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.442465 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442336 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.442556 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.442537 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-manifests\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.444372 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.444355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83cafe49-3f0d-4e04-bf2f-09c5965ef686-tmp\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.444779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.444756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.444820 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.444759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83cafe49-3f0d-4e04-bf2f-09c5965ef686-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.450624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.450603 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gchhf\" (UniqueName: \"kubernetes.io/projected/83cafe49-3f0d-4e04-bf2f-09c5965ef686-kube-api-access-gchhf\") pod \"opendatahub-operator-controller-manager-58fdbbf655-dwclj\" (UID: \"83cafe49-3f0d-4e04-bf2f-09c5965ef686\") " pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.542792 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.542758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.560621 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.560592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:30.642821 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.642713 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.708195 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.704115 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj"] Jul 16 20:38:30.743926 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.743879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:30.834165 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.834135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" event={"ID":"83cafe49-3f0d-4e04-bf2f-09c5965ef686","Type":"ContainerStarted","Data":"92ed21287ff4cfc2df474202faa5e3a6afcf1f228b1263e72c57de4797f549f9"} Jul 16 20:38:30.847807 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:30.847774 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:33.852694 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:33.852613 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" event={"ID":"83cafe49-3f0d-4e04-bf2f-09c5965ef686","Type":"ContainerStarted","Data":"fdd10c337d83f78c96fe904c2390f353ac45de10e00676f4c8787cce21e77cd2"} Jul 16 20:38:34.858941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:34.858886 2563 generic.go:356] "Generic (PLEG): container finished" podID="83cafe49-3f0d-4e04-bf2f-09c5965ef686" containerID="fdd10c337d83f78c96fe904c2390f353ac45de10e00676f4c8787cce21e77cd2" exitCode=0 Jul 16 20:38:34.858941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:34.858929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" event={"ID":"83cafe49-3f0d-4e04-bf2f-09c5965ef686","Type":"ContainerDied","Data":"fdd10c337d83f78c96fe904c2390f353ac45de10e00676f4c8787cce21e77cd2"} Jul 16 20:38:36.870534 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:36.870503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" event={"ID":"83cafe49-3f0d-4e04-bf2f-09c5965ef686","Type":"ContainerStarted","Data":"7c78f17260b19f0bddb67e25d2a56390999c1bc638bbd31e9465f2afa8605ea2"} Jul 16 20:38:36.870918 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:36.870613 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:36.892520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:36.892478 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" podStartSLOduration=1.8300105869999999 podStartE2EDuration="6.892464768s" totalImagesPullingTime="3.982518943s" totalInitContainerRuntime="1.079935238s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:38:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:38:36.890540413 +0000 UTC m=+340.149499887" watchObservedRunningTime="2026-07-16 20:38:36.892464768 +0000 UTC m=+340.151424216" Jul 16 20:38:41.860579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:41.860549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:42.314845 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:42.314809 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:47.877507 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:47.877470 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58fdbbf655-dwclj" Jul 16 20:38:49.451465 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:49.451434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:49.598187 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:49.598153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:50.347614 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:50.347583 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:50.458199 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:50.458165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:50.606271 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:50.606195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:50.855952 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:50.855922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:51.089180 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:51.089152 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:51.163367 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:51.163333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:38:58.489099 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.489060 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8"] Jul 16 20:38:58.493379 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.493355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.496348 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.496329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 20:38:58.497558 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.497541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-76cz9\"" Jul 16 20:38:58.497632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.497541 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 20:38:58.497632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.497597 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 20:38:58.507774 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.507752 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8"] Jul 16 20:38:58.580434 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.580397 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-metrics-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.580621 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.580447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.580621 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.580488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/debee3c7-922d-40cb-a1e7-7a351acd4a0d-manager-config\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.580621 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.580557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrrk\" (UniqueName: \"kubernetes.io/projected/debee3c7-922d-40cb-a1e7-7a351acd4a0d-kube-api-access-6hrrk\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.681530 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.681499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrrk\" (UniqueName: \"kubernetes.io/projected/debee3c7-922d-40cb-a1e7-7a351acd4a0d-kube-api-access-6hrrk\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.681721 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.681540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-metrics-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.681721 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.681667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.681721 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.681714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/debee3c7-922d-40cb-a1e7-7a351acd4a0d-manager-config\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.682391 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.682368 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/debee3c7-922d-40cb-a1e7-7a351acd4a0d-manager-config\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.684091 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.684070 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-metrics-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.684264 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.684212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/debee3c7-922d-40cb-a1e7-7a351acd4a0d-cert\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.690316 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.690294 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrrk\" (UniqueName: \"kubernetes.io/projected/debee3c7-922d-40cb-a1e7-7a351acd4a0d-kube-api-access-6hrrk\") pod \"lws-controller-manager-56b64d78d7-xx5r8\" (UID: \"debee3c7-922d-40cb-a1e7-7a351acd4a0d\") " pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.803267 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.803179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:38:58.949118 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.949093 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8"] Jul 16 20:38:58.951236 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:38:58.951210 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebee3c7_922d_40cb_a1e7_7a351acd4a0d.slice/crio-0209be1cb0abe2d2ce48f6fd2775275599570a58a94854d15baf36ac579206c4 WatchSource:0}: Error finding container 0209be1cb0abe2d2ce48f6fd2775275599570a58a94854d15baf36ac579206c4: Status 404 returned error can't find the container with id 0209be1cb0abe2d2ce48f6fd2775275599570a58a94854d15baf36ac579206c4 Jul 16 20:38:58.976217 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.976185 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" event={"ID":"debee3c7-922d-40cb-a1e7-7a351acd4a0d","Type":"ContainerStarted","Data":"0209be1cb0abe2d2ce48f6fd2775275599570a58a94854d15baf36ac579206c4"} Jul 16 20:38:58.983775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:38:58.983736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:00.210087 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.209984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:00.342060 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.342028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:00.653038 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.653006 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74779b8bd6-d652d"] Jul 16 20:39:00.655591 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.655574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.659866 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.659842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 20:39:00.659866 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.659858 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 20:39:00.661157 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.661138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tmlvp\"" Jul 16 20:39:00.661443 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.661420 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 20:39:00.661725 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.661705 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 20:39:00.676320 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.676297 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74779b8bd6-d652d"] Jul 16 20:39:00.694713 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.694691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fflft\" (UniqueName: \"kubernetes.io/projected/3481015d-0232-4d6d-ae4a-ce454b1ee27a-kube-api-access-fflft\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.694835 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.694816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tmp\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.694924 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.694868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tls-certs\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.699093 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.699073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:00.795326 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.795248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tmp\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.795326 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.795294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tls-certs\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.795565 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.795463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fflft\" (UniqueName: \"kubernetes.io/projected/3481015d-0232-4d6d-ae4a-ce454b1ee27a-kube-api-access-fflft\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.800247 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.800196 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tmp\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.800567 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.800543 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3481015d-0232-4d6d-ae4a-ce454b1ee27a-tls-certs\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.801731 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.801699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:00.808175 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.808150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fflft\" (UniqueName: \"kubernetes.io/projected/3481015d-0232-4d6d-ae4a-ce454b1ee27a-kube-api-access-fflft\") pod \"kube-auth-proxy-74779b8bd6-d652d\" (UID: \"3481015d-0232-4d6d-ae4a-ce454b1ee27a\") " pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.965894 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.965860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" Jul 16 20:39:00.987985 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.987950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" event={"ID":"debee3c7-922d-40cb-a1e7-7a351acd4a0d","Type":"ContainerStarted","Data":"05a096c27ffcd7ac59360787b23f2af601edd75466a1a72b9cfeab46a7a6adff"} Jul 16 20:39:00.988107 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:00.988090 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:39:01.010065 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:01.010017 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" podStartSLOduration=1.432657872 podStartE2EDuration="3.010000807s" totalImagesPullingTime="1.577342935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:39:01.008142391 +0000 UTC m=+364.267101847" watchObservedRunningTime="2026-07-16 20:39:01.010000807 +0000 UTC m=+364.268960255" Jul 16 20:39:01.144757 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:01.144731 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74779b8bd6-d652d"] Jul 16 20:39:01.146894 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:39:01.146869 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3481015d_0232_4d6d_ae4a_ce454b1ee27a.slice/crio-7d2f1cc15b9a7729c0ae81ff0fed46af6bdc4fdcf04630680e006209aec7f4aa WatchSource:0}: Error finding container 7d2f1cc15b9a7729c0ae81ff0fed46af6bdc4fdcf04630680e006209aec7f4aa: Status 404 returned error can't find the container with id 7d2f1cc15b9a7729c0ae81ff0fed46af6bdc4fdcf04630680e006209aec7f4aa Jul 16 20:39:01.532250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:01.532221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:01.640474 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:01.640435 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:01.997705 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:01.997666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" event={"ID":"3481015d-0232-4d6d-ae4a-ce454b1ee27a","Type":"ContainerStarted","Data":"7d2f1cc15b9a7729c0ae81ff0fed46af6bdc4fdcf04630680e006209aec7f4aa"} Jul 16 20:39:03.582874 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:03.582798 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:03.682221 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:03.682187 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:04.010052 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:04.010012 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" event={"ID":"3481015d-0232-4d6d-ae4a-ce454b1ee27a","Type":"ContainerStarted","Data":"3e1acd5a34af2ab5dbc08f6ff8a8e7710325d526809d1e9daeb25e68e8088ebb"} Jul 16 20:39:04.050339 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:04.050276 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74779b8bd6-d652d" podStartSLOduration=2.059730577 podStartE2EDuration="4.050247683s" totalImagesPullingTime="1.990517106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:39:04.049290318 +0000 UTC m=+367.308249768" watchObservedRunningTime="2026-07-16 20:39:04.050247683 +0000 UTC m=+367.309207133" Jul 16 20:39:05.151750 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:05.151711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:08.299083 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:08.299047 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:08.454007 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:08.453976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:09.221824 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:09.221770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:09.519636 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:09.519532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:09.681644 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:09.681600 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:12.000733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:12.000697 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56b64d78d7-xx5r8" Jul 16 20:39:51.011950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:51.011885 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:51.154070 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:51.154025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:51.256484 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:51.256451 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:51.951826 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:51.951799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:39:52.162071 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:39:52.162042 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:06.764975 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.764940 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl"] Jul 16 20:40:06.767949 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.767923 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.768633 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.768605 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl"] Jul 16 20:40:06.770496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.770477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 20:40:06.771446 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.771430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 20:40:06.771538 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.771441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-27m6w\"" Jul 16 20:40:06.854496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.854466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.854692 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.854501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5xtv\" (UniqueName: \"kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.854692 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.854530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.955172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.955133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.955172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.955173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xtv\" (UniqueName: \"kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.955346 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.955204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.955537 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.955521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.955573 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.955557 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:06.963565 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:06.963530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5xtv\" (UniqueName: \"kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:07.078780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.078703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:07.155520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.155486 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7"] Jul 16 20:40:07.159124 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.159102 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.170632 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.170570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7"] Jul 16 20:40:07.219437 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.219415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl"] Jul 16 20:40:07.221485 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:07.221456 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6384a42c_58ec_4e60_9e22_aff62f703a6d.slice/crio-36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0 WatchSource:0}: Error finding container 36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0: Status 404 returned error can't find the container with id 36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0 Jul 16 20:40:07.258005 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.257980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.258128 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.258016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzz4\" (UniqueName: \"kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.258201 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.258180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.314207 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.314169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerStarted","Data":"15fd486ce560aeac1b9f1bd0456492c7b391e584163e172de37ef90529b189ce"} Jul 16 20:40:07.314401 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.314221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerStarted","Data":"36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0"} Jul 16 20:40:07.359688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.359626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.359688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.359665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.359838 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.359692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzz4\" (UniqueName: \"kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.360065 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.360042 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.360130 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.360074 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.367278 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.367260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzz4\" (UniqueName: \"kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.471868 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.471838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:07.557243 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.557204 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h"] Jul 16 20:40:07.560871 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.560853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.568423 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.568379 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h"] Jul 16 20:40:07.606038 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.606016 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7"] Jul 16 20:40:07.607772 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:07.607745 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4f7686_e6b1_4f40_9430_f393228c5b58.slice/crio-6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c WatchSource:0}: Error finding container 6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c: Status 404 returned error can't find the container with id 6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c Jul 16 20:40:07.662204 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.662180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wtm5\" (UniqueName: \"kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.662322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.662221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.662322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.662277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.762885 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.762855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.763023 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.762977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtm5\" (UniqueName: \"kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.763023 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.763009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.763264 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.763242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.763303 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.763253 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.771629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.771610 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtm5\" (UniqueName: \"kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.872301 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.872241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:07.956322 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.956291 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t"] Jul 16 20:40:07.959155 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.959137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:07.968678 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:07.968650 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t"] Jul 16 20:40:08.019343 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.019319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h"] Jul 16 20:40:08.021244 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:08.021210 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ac57f7_b7e3_4fbc_9561_d55f3578c919.slice/crio-c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949 WatchSource:0}: Error finding container c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949: Status 404 returned error can't find the container with id c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949 Jul 16 20:40:08.064715 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.064693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.064823 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.064727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.064823 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.064764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d567\" (UniqueName: \"kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.166246 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.166213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.166356 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.166268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d567\" (UniqueName: \"kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.166356 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.166330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.166573 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.166556 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.166613 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.166590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.175319 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.175292 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d567\" (UniqueName: \"kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.288433 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.288400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:08.322095 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.322024 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerID="e80067b1885bf8416bf596fbdbbfbcfc20ac9e784006cb9bf3605a9d1a05d98a" exitCode=0 Jul 16 20:40:08.322224 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.322116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" event={"ID":"5c4f7686-e6b1-4f40-9430-f393228c5b58","Type":"ContainerDied","Data":"e80067b1885bf8416bf596fbdbbfbcfc20ac9e784006cb9bf3605a9d1a05d98a"} Jul 16 20:40:08.322224 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.322165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" event={"ID":"5c4f7686-e6b1-4f40-9430-f393228c5b58","Type":"ContainerStarted","Data":"6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c"} Jul 16 20:40:08.323940 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.323895 2563 generic.go:356] "Generic (PLEG): container finished" podID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerID="15fd486ce560aeac1b9f1bd0456492c7b391e584163e172de37ef90529b189ce" exitCode=0 Jul 16 20:40:08.324496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.324168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerDied","Data":"15fd486ce560aeac1b9f1bd0456492c7b391e584163e172de37ef90529b189ce"} Jul 16 20:40:08.326168 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.326141 2563 generic.go:356] "Generic (PLEG): container finished" podID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerID="b4e3bdca6d0ab4ab1a37680768736ea2b82a4e77ddd08f112ba6cab783335ad0" exitCode=0 Jul 16 20:40:08.326281 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.326215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" event={"ID":"15ac57f7-b7e3-4fbc-9561-d55f3578c919","Type":"ContainerDied","Data":"b4e3bdca6d0ab4ab1a37680768736ea2b82a4e77ddd08f112ba6cab783335ad0"} Jul 16 20:40:08.326281 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.326248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" event={"ID":"15ac57f7-b7e3-4fbc-9561-d55f3578c919","Type":"ContainerStarted","Data":"c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949"} Jul 16 20:40:08.427969 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:08.427945 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t"] Jul 16 20:40:08.429722 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:08.429697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7a4715_fd89_424d_aa46_6ede9e299d72.slice/crio-53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff WatchSource:0}: Error finding container 53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff: Status 404 returned error can't find the container with id 53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff Jul 16 20:40:09.332870 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:09.332837 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerID="0a56bfbea2221e57b687910a636a1795b5fd7ff13d2facfd0f416a0da2d5e260" exitCode=0 Jul 16 20:40:09.333242 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:09.332929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" event={"ID":"5c7a4715-fd89-424d-aa46-6ede9e299d72","Type":"ContainerDied","Data":"0a56bfbea2221e57b687910a636a1795b5fd7ff13d2facfd0f416a0da2d5e260"} Jul 16 20:40:09.333242 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:09.332980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" event={"ID":"5c7a4715-fd89-424d-aa46-6ede9e299d72","Type":"ContainerStarted","Data":"53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff"} Jul 16 20:40:09.335030 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:09.335002 2563 generic.go:356] "Generic (PLEG): container finished" podID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerID="f60e6036fe5ae15c32459f2b8c788587ca4bcb1a59dc2628461ebd348f92b1a4" exitCode=0 Jul 16 20:40:09.335151 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:09.335041 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerDied","Data":"f60e6036fe5ae15c32459f2b8c788587ca4bcb1a59dc2628461ebd348f92b1a4"} Jul 16 20:40:10.342026 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:10.341989 2563 generic.go:356] "Generic (PLEG): container finished" podID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerID="b24c1fd14b55fae770b7a8b73813c76ccad0c1812f1ae3c88939c34733c6ea72" exitCode=0 Jul 16 20:40:10.342399 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:10.342084 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" event={"ID":"15ac57f7-b7e3-4fbc-9561-d55f3578c919","Type":"ContainerDied","Data":"b24c1fd14b55fae770b7a8b73813c76ccad0c1812f1ae3c88939c34733c6ea72"} Jul 16 20:40:10.344738 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:10.344713 2563 generic.go:356] "Generic (PLEG): container finished" podID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerID="3dda6ca26a8d1cbf0d98e74faa716c652cbfbf5aab44a1067e6e01fd9655c4db" exitCode=0 Jul 16 20:40:10.344843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:10.344767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerDied","Data":"3dda6ca26a8d1cbf0d98e74faa716c652cbfbf5aab44a1067e6e01fd9655c4db"} Jul 16 20:40:11.351540 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.351451 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerID="cd0d7848a28a50730a58bb651f60fbeac7cf8c68c75b28744ff7c0c65f8e25d4" exitCode=0 Jul 16 20:40:11.351954 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.351542 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" event={"ID":"5c4f7686-e6b1-4f40-9430-f393228c5b58","Type":"ContainerDied","Data":"cd0d7848a28a50730a58bb651f60fbeac7cf8c68c75b28744ff7c0c65f8e25d4"} Jul 16 20:40:11.353682 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.353662 2563 generic.go:356] "Generic (PLEG): container finished" podID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerID="a01bcb42a7a974f8bbf2cf88046e358ca72db915baa5ab311c609ac6d6b5ddbb" exitCode=0 Jul 16 20:40:11.353772 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.353733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" event={"ID":"15ac57f7-b7e3-4fbc-9561-d55f3578c919","Type":"ContainerDied","Data":"a01bcb42a7a974f8bbf2cf88046e358ca72db915baa5ab311c609ac6d6b5ddbb"} Jul 16 20:40:11.355579 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.355560 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerID="ce3bb7705e0d3c7c4a74e1d3764da25eeac85500a5c06ee3d7977d4422c22510" exitCode=0 Jul 16 20:40:11.355667 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.355588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" event={"ID":"5c7a4715-fd89-424d-aa46-6ede9e299d72","Type":"ContainerDied","Data":"ce3bb7705e0d3c7c4a74e1d3764da25eeac85500a5c06ee3d7977d4422c22510"} Jul 16 20:40:11.498552 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.498525 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:11.599215 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.599188 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util\") pod \"6384a42c-58ec-4e60-9e22-aff62f703a6d\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " Jul 16 20:40:11.599344 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.599224 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5xtv\" (UniqueName: \"kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv\") pod \"6384a42c-58ec-4e60-9e22-aff62f703a6d\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " Jul 16 20:40:11.599344 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.599307 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle\") pod \"6384a42c-58ec-4e60-9e22-aff62f703a6d\" (UID: \"6384a42c-58ec-4e60-9e22-aff62f703a6d\") " Jul 16 20:40:11.599785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.599757 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle" (OuterVolumeSpecName: "bundle") pod "6384a42c-58ec-4e60-9e22-aff62f703a6d" (UID: "6384a42c-58ec-4e60-9e22-aff62f703a6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:11.601510 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.601486 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv" (OuterVolumeSpecName: "kube-api-access-j5xtv") pod "6384a42c-58ec-4e60-9e22-aff62f703a6d" (UID: "6384a42c-58ec-4e60-9e22-aff62f703a6d"). InnerVolumeSpecName "kube-api-access-j5xtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:40:11.604688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.604626 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util" (OuterVolumeSpecName: "util") pod "6384a42c-58ec-4e60-9e22-aff62f703a6d" (UID: "6384a42c-58ec-4e60-9e22-aff62f703a6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:11.699823 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.699796 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:11.699823 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.699820 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5xtv\" (UniqueName: \"kubernetes.io/projected/6384a42c-58ec-4e60-9e22-aff62f703a6d-kube-api-access-j5xtv\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:11.699962 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:11.699830 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6384a42c-58ec-4e60-9e22-aff62f703a6d-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:12.150218 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.150183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:12.362659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.362575 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerID="3cfcd4f586c5426c864710e70b209e28205e63e543fc322288a65790c6d810fb" exitCode=0 Jul 16 20:40:12.363122 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.362658 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" event={"ID":"5c4f7686-e6b1-4f40-9430-f393228c5b58","Type":"ContainerDied","Data":"3cfcd4f586c5426c864710e70b209e28205e63e543fc322288a65790c6d810fb"} Jul 16 20:40:12.364492 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.364472 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" Jul 16 20:40:12.364606 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.364518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl" event={"ID":"6384a42c-58ec-4e60-9e22-aff62f703a6d","Type":"ContainerDied","Data":"36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0"} Jul 16 20:40:12.364606 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.364557 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36aa893f2c5f63ca92f3b7a523ff73d63875d8bedc43cb826f2bc0b936aaa6a0" Jul 16 20:40:12.366707 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.366683 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerID="6ea2de28e28de57683e457721400fbec26ab41974bd33c08e144b43176f802de" exitCode=0 Jul 16 20:40:12.366833 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.366751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" event={"ID":"5c7a4715-fd89-424d-aa46-6ede9e299d72","Type":"ContainerDied","Data":"6ea2de28e28de57683e457721400fbec26ab41974bd33c08e144b43176f802de"} Jul 16 20:40:12.501320 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.501294 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:12.607364 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.607339 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util\") pod \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " Jul 16 20:40:12.607508 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.607372 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wtm5\" (UniqueName: \"kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5\") pod \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " Jul 16 20:40:12.607508 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.607398 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle\") pod \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\" (UID: \"15ac57f7-b7e3-4fbc-9561-d55f3578c919\") " Jul 16 20:40:12.607955 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.607892 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle" (OuterVolumeSpecName: "bundle") pod "15ac57f7-b7e3-4fbc-9561-d55f3578c919" (UID: "15ac57f7-b7e3-4fbc-9561-d55f3578c919"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:12.609522 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.609501 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5" (OuterVolumeSpecName: "kube-api-access-7wtm5") pod "15ac57f7-b7e3-4fbc-9561-d55f3578c919" (UID: "15ac57f7-b7e3-4fbc-9561-d55f3578c919"). InnerVolumeSpecName "kube-api-access-7wtm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:40:12.612719 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.612666 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util" (OuterVolumeSpecName: "util") pod "15ac57f7-b7e3-4fbc-9561-d55f3578c919" (UID: "15ac57f7-b7e3-4fbc-9561-d55f3578c919"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:12.708710 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.708682 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:12.708710 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.708709 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wtm5\" (UniqueName: \"kubernetes.io/projected/15ac57f7-b7e3-4fbc-9561-d55f3578c919-kube-api-access-7wtm5\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:12.708861 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:12.708723 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/15ac57f7-b7e3-4fbc-9561-d55f3578c919-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.373196 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.373156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" event={"ID":"15ac57f7-b7e3-4fbc-9561-d55f3578c919","Type":"ContainerDied","Data":"c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949"} Jul 16 20:40:13.373196 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.373185 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h" Jul 16 20:40:13.373666 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.373209 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c710bbba4afde08cc1aae3a431a79652fea4a62ff597bcc3f128ca6d52fb7949" Jul 16 20:40:13.529984 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.529931 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:13.532543 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.532527 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:13.616955 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.616898 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle\") pod \"5c4f7686-e6b1-4f40-9430-f393228c5b58\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " Jul 16 20:40:13.617138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.616967 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d567\" (UniqueName: \"kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567\") pod \"5c7a4715-fd89-424d-aa46-6ede9e299d72\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " Jul 16 20:40:13.617138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.616987 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util\") pod \"5c7a4715-fd89-424d-aa46-6ede9e299d72\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " Jul 16 20:40:13.617138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.617036 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle\") pod \"5c7a4715-fd89-424d-aa46-6ede9e299d72\" (UID: \"5c7a4715-fd89-424d-aa46-6ede9e299d72\") " Jul 16 20:40:13.617138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.617091 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util\") pod \"5c4f7686-e6b1-4f40-9430-f393228c5b58\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " Jul 16 20:40:13.617138 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.617130 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrzz4\" (UniqueName: \"kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4\") pod \"5c4f7686-e6b1-4f40-9430-f393228c5b58\" (UID: \"5c4f7686-e6b1-4f40-9430-f393228c5b58\") " Jul 16 20:40:13.617631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.617602 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle" (OuterVolumeSpecName: "bundle") pod "5c7a4715-fd89-424d-aa46-6ede9e299d72" (UID: "5c7a4715-fd89-424d-aa46-6ede9e299d72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:13.617758 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.617626 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle" (OuterVolumeSpecName: "bundle") pod "5c4f7686-e6b1-4f40-9430-f393228c5b58" (UID: "5c4f7686-e6b1-4f40-9430-f393228c5b58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:13.619409 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.619381 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4" (OuterVolumeSpecName: "kube-api-access-nrzz4") pod "5c4f7686-e6b1-4f40-9430-f393228c5b58" (UID: "5c4f7686-e6b1-4f40-9430-f393228c5b58"). InnerVolumeSpecName "kube-api-access-nrzz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:40:13.619629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.619603 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567" (OuterVolumeSpecName: "kube-api-access-9d567") pod "5c7a4715-fd89-424d-aa46-6ede9e299d72" (UID: "5c7a4715-fd89-424d-aa46-6ede9e299d72"). InnerVolumeSpecName "kube-api-access-9d567". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:40:13.622594 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.622571 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util" (OuterVolumeSpecName: "util") pod "5c7a4715-fd89-424d-aa46-6ede9e299d72" (UID: "5c7a4715-fd89-424d-aa46-6ede9e299d72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:13.622683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.622646 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util" (OuterVolumeSpecName: "util") pod "5c4f7686-e6b1-4f40-9430-f393228c5b58" (UID: "5c4f7686-e6b1-4f40-9430-f393228c5b58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 20:40:13.718747 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718721 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrzz4\" (UniqueName: \"kubernetes.io/projected/5c4f7686-e6b1-4f40-9430-f393228c5b58-kube-api-access-nrzz4\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.718747 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718743 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.718747 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718753 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d567\" (UniqueName: \"kubernetes.io/projected/5c7a4715-fd89-424d-aa46-6ede9e299d72-kube-api-access-9d567\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.718966 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718761 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.718966 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718769 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c7a4715-fd89-424d-aa46-6ede9e299d72-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:13.718966 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:13.718776 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7686-e6b1-4f40-9430-f393228c5b58-util\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:40:14.381254 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.381225 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" Jul 16 20:40:14.381688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.381252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7" event={"ID":"5c4f7686-e6b1-4f40-9430-f393228c5b58","Type":"ContainerDied","Data":"6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c"} Jul 16 20:40:14.381688 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.381298 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6887b46fc064fb189f57cbf60f74311a6848f069708a872130b0527b9c3b341c" Jul 16 20:40:14.383181 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.383156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" event={"ID":"5c7a4715-fd89-424d-aa46-6ede9e299d72","Type":"ContainerDied","Data":"53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff"} Jul 16 20:40:14.383319 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.383199 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53bd76b038fd392f1383e98d4e9043d1a16426ec95bf99dc4cc3a09790ef07ff" Jul 16 20:40:14.383319 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:14.383162 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t" Jul 16 20:40:20.065592 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:20.065515 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:23.472603 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:23.472553 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:28.117438 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:28.117402 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:28.285391 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:28.285361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:28.419772 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:28.419746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:29.038139 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:29.038088 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:31.209375 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:31.209329 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:31.377014 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:31.376982 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:32.493403 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:32.493376 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:33.819894 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:33.819861 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:35.706255 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:35.706227 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:35.826394 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:35.826363 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:36.138402 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138368 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67474577d-gc76k"] Jul 16 20:40:36.138745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138729 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="util" Jul 16 20:40:36.138745 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138745 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138764 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="pull" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138773 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="pull" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138785 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138792 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138801 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138809 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138816 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="extract" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138821 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="extract" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138826 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="extract" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138832 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="extract" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138848 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138855 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="util" Jul 16 20:40:36.138862 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138866 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138873 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138879 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138884 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138892 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138897 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138924 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138930 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="pull" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138935 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.138939 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.139005 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6384a42c-58ec-4e60-9e22-aff62f703a6d" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.139017 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ac57f7-b7e3-4fbc-9561-d55f3578c919" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.139023 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c4f7686-e6b1-4f40-9430-f393228c5b58" containerName="extract" Jul 16 20:40:36.139496 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.139027 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7a4715-fd89-424d-aa46-6ede9e299d72" containerName="extract" Jul 16 20:40:36.143703 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.143684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.167536 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.167513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67474577d-gc76k"] Jul 16 20:40:36.210924 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.210867 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:36.316028 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.315998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-oauth-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316151 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316151 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-oauth-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316151 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-service-ca\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316313 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316313 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmg86\" (UniqueName: \"kubernetes.io/projected/c2dda2fa-61a9-45b6-9971-fe89812f7b62-kube-api-access-wmg86\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.316313 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.316215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-trusted-ca-bundle\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.345631 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.345601 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:36.417629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-service-ca\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmg86\" (UniqueName: \"kubernetes.io/projected/c2dda2fa-61a9-45b6-9971-fe89812f7b62-kube-api-access-wmg86\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-trusted-ca-bundle\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417889 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-oauth-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417889 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.417889 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.417850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-oauth-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.418336 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.418313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-service-ca\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.418558 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.418539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.418608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.418554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-oauth-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.418608 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.418593 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dda2fa-61a9-45b6-9971-fe89812f7b62-trusted-ca-bundle\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.420530 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.420502 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-oauth-config\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.420728 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.420712 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dda2fa-61a9-45b6-9971-fe89812f7b62-console-serving-cert\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.439065 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.439041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmg86\" (UniqueName: \"kubernetes.io/projected/c2dda2fa-61a9-45b6-9971-fe89812f7b62-kube-api-access-wmg86\") pod \"console-67474577d-gc76k\" (UID: \"c2dda2fa-61a9-45b6-9971-fe89812f7b62\") " pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.452941 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.452897 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:36.602354 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:36.602331 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67474577d-gc76k"] Jul 16 20:40:36.603470 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:36.603447 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dda2fa_61a9_45b6_9971_fe89812f7b62.slice/crio-ca145f89b5bf4dd223d0bf9ee2ec7b24236f3cd5e6c781a06f57302bb748914a WatchSource:0}: Error finding container ca145f89b5bf4dd223d0bf9ee2ec7b24236f3cd5e6c781a06f57302bb748914a: Status 404 returned error can't find the container with id ca145f89b5bf4dd223d0bf9ee2ec7b24236f3cd5e6c781a06f57302bb748914a Jul 16 20:40:37.509857 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:37.509810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474577d-gc76k" event={"ID":"c2dda2fa-61a9-45b6-9971-fe89812f7b62","Type":"ContainerStarted","Data":"0540519cffd39b8176324814dedbed7e8379da3f71721ea97d47fc22ad342ae0"} Jul 16 20:40:37.510230 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:37.509873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474577d-gc76k" event={"ID":"c2dda2fa-61a9-45b6-9971-fe89812f7b62","Type":"ContainerStarted","Data":"ca145f89b5bf4dd223d0bf9ee2ec7b24236f3cd5e6c781a06f57302bb748914a"} Jul 16 20:40:37.529344 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:37.529295 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67474577d-gc76k" podStartSLOduration=1.529277044 podStartE2EDuration="1.529277044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:40:37.528669657 +0000 UTC m=+460.787629109" watchObservedRunningTime="2026-07-16 20:40:37.529277044 +0000 UTC m=+460.788236494" Jul 16 20:40:38.420299 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.420261 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg"] Jul 16 20:40:38.423880 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.423864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.426283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.426261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:38.432978 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.432960 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 16 20:40:38.434046 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434027 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 20:40:38.434046 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434038 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-27m6w\"" Jul 16 20:40:38.434172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434066 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 16 20:40:38.434172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434083 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 20:40:38.434551 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f5d9\" (UniqueName: \"kubernetes.io/projected/661e5a8c-7665-4943-b601-024034df2426-kube-api-access-5f5d9\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.434590 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/661e5a8c-7665-4943-b601-024034df2426-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.434636 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.434601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.443577 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.443557 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg"] Jul 16 20:40:38.535793 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.535762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f5d9\" (UniqueName: \"kubernetes.io/projected/661e5a8c-7665-4943-b601-024034df2426-kube-api-access-5f5d9\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.536243 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.535799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/661e5a8c-7665-4943-b601-024034df2426-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.536243 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.535986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.536243 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:40:38.536132 2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 16 20:40:38.536243 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:40:38.536209 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert podName:661e5a8c-7665-4943-b601-024034df2426 nodeName:}" failed. No retries permitted until 2026-07-16 20:40:39.036190407 +0000 UTC m=+462.295149837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9qnmg" (UID: "661e5a8c-7665-4943-b601-024034df2426") : secret "plugin-serving-cert" not found Jul 16 20:40:38.536541 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.536521 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/661e5a8c-7665-4943-b601-024034df2426-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.545166 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.545145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f5d9\" (UniqueName: \"kubernetes.io/projected/661e5a8c-7665-4943-b601-024034df2426-kube-api-access-5f5d9\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:38.607330 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:38.607308 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:39.039408 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.039378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:39.041931 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.041880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/661e5a8c-7665-4943-b601-024034df2426-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9qnmg\" (UID: \"661e5a8c-7665-4943-b601-024034df2426\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:39.088746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.088717 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:39.332952 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.332859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" Jul 16 20:40:39.465059 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.465025 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg"] Jul 16 20:40:39.467015 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:40:39.466990 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod661e5a8c_7665_4943_b601_024034df2426.slice/crio-b30e948e47d905e125c40b9e043a33a510c1c015025793e9422fde7484a1e3b0 WatchSource:0}: Error finding container b30e948e47d905e125c40b9e043a33a510c1c015025793e9422fde7484a1e3b0: Status 404 returned error can't find the container with id b30e948e47d905e125c40b9e043a33a510c1c015025793e9422fde7484a1e3b0 Jul 16 20:40:39.473962 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.473940 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:39.521973 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.521950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" event={"ID":"661e5a8c-7665-4943-b601-024034df2426","Type":"ContainerStarted","Data":"b30e948e47d905e125c40b9e043a33a510c1c015025793e9422fde7484a1e3b0"} Jul 16 20:40:39.552055 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:39.552032 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:42.486466 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:42.486427 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:46.453658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.453619 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:46.454119 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.453689 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:46.459027 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.459004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:46.575149 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.575122 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67474577d-gc76k" Jul 16 20:40:46.689969 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.689927 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:40:46.859274 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.859188 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:46.968241 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:46.968181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:48.791749 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:48.791705 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:48.991140 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:48.991101 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:51.775431 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:51.775382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:51.925948 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:51.925887 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:54.304960 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:54.304922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:54.409270 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:54.409231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:58.197676 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:58.197637 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:40:58.323236 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:40:58.323193 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:01.672035 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:01.671996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" event={"ID":"661e5a8c-7665-4943-b601-024034df2426","Type":"ContainerStarted","Data":"b47b2bf0e3082a557ae0d15fd8f827b46ea4865e408fa3cc83ad22a4a75d6a95"} Jul 16 20:41:01.693345 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:01.693286 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9qnmg" podStartSLOduration=2.2142043 podStartE2EDuration="23.693273262s" totalImagesPullingTime="21.479068962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:41:01.689806996 +0000 UTC m=+484.948766445" watchObservedRunningTime="2026-07-16 20:41:01.693273262 +0000 UTC m=+484.952232709" Jul 16 20:41:08.108368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:08.108320 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:08.204918 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:08.204871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:11.099940 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:11.099877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:11.200886 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:11.200848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:11.715421 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:11.715385 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59fd7dd674-lhkj7" podUID="2e7a18ad-7909-4682-ac9e-7c2201288c78" containerName="console" containerID="cri-o://ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c" gracePeriod=15 Jul 16 20:41:12.080414 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.080381 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:41:12.246824 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.246794 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.246893 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7ws7\" (UniqueName: \"kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.246949 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.246970 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247000 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247020 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247036 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config\") pod \"2e7a18ad-7909-4682-ac9e-7c2201288c78\" (UID: \"2e7a18ad-7909-4682-ac9e-7c2201288c78\") " Jul 16 20:41:12.247312 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247264 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:41:12.247648 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247428 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:41:12.247648 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247446 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:41:12.247648 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.247607 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config" (OuterVolumeSpecName: "console-config") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:41:12.249398 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.249373 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7" (OuterVolumeSpecName: "kube-api-access-p7ws7") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "kube-api-access-p7ws7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:12.249504 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.249419 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:41:12.249504 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.249478 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e7a18ad-7909-4682-ac9e-7c2201288c78" (UID: "2e7a18ad-7909-4682-ac9e-7c2201288c78"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348701 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7ws7\" (UniqueName: \"kubernetes.io/projected/2e7a18ad-7909-4682-ac9e-7c2201288c78-kube-api-access-p7ws7\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348734 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-trusted-ca-bundle\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348747 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348760 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-oauth-serving-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348772 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348781 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e7a18ad-7909-4682-ac9e-7c2201288c78-console-oauth-config\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.348802 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.348790 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e7a18ad-7909-4682-ac9e-7c2201288c78-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:12.729371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.729337 2563 generic.go:356] "Generic (PLEG): container finished" podID="2e7a18ad-7909-4682-ac9e-7c2201288c78" containerID="ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c" exitCode=0 Jul 16 20:41:12.729541 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.729385 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd7dd674-lhkj7" Jul 16 20:41:12.729541 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.729421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd7dd674-lhkj7" event={"ID":"2e7a18ad-7909-4682-ac9e-7c2201288c78","Type":"ContainerDied","Data":"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c"} Jul 16 20:41:12.729541 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.729472 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd7dd674-lhkj7" event={"ID":"2e7a18ad-7909-4682-ac9e-7c2201288c78","Type":"ContainerDied","Data":"04d776de6daf27f298ab7e3039fe0e400e945e6aec428ec3497d8b316bde8e84"} Jul 16 20:41:12.729541 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.729491 2563 scope.go:117] "RemoveContainer" containerID="ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c" Jul 16 20:41:12.738894 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.738875 2563 scope.go:117] "RemoveContainer" containerID="ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c" Jul 16 20:41:12.739192 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:41:12.739173 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c\": container with ID starting with ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c not found: ID does not exist" containerID="ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c" Jul 16 20:41:12.739255 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.739205 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c"} err="failed to get container status \"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c\": rpc error: code = NotFound desc = could not find container \"ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c\": container with ID starting with ac76e5a273210ac099235008b5282ec93b625888a7b3f0c61a8fedecb151602c not found: ID does not exist" Jul 16 20:41:12.751690 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.751666 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:41:12.758121 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:12.758101 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59fd7dd674-lhkj7"] Jul 16 20:41:13.261937 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:13.261131 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e7a18ad-7909-4682-ac9e-7c2201288c78" path="/var/lib/kubelet/pods/2e7a18ad-7909-4682-ac9e-7c2201288c78/volumes" Jul 16 20:41:19.436732 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:19.436694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:19.927913 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:19.927865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.175302 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.175267 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.275406 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.275363 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.390217 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.390181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:21.924790 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.924758 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:21.925167 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.925152 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7a18ad-7909-4682-ac9e-7c2201288c78" containerName="console" Jul 16 20:41:21.925219 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.925169 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7a18ad-7909-4682-ac9e-7c2201288c78" containerName="console" Jul 16 20:41:21.925255 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.925243 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7a18ad-7909-4682-ac9e-7c2201288c78" containerName="console" Jul 16 20:41:21.927307 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.927291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:21.929872 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.929857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8q9jc\"" Jul 16 20:41:21.943061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.943035 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:21.963276 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:21.963253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:22.022983 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.022953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:22.027257 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.027234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hb5q\" (UniqueName: \"kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q\") pod \"authorino-58cd955675-vw64m\" (UID: \"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b\") " pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:22.047722 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.047699 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:22.050174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.050159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:22.058166 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.058146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:22.128172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.128141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hb5q\" (UniqueName: \"kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q\") pod \"authorino-58cd955675-vw64m\" (UID: \"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b\") " pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:22.136591 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.136567 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hb5q\" (UniqueName: \"kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q\") pod \"authorino-58cd955675-vw64m\" (UID: \"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b\") " pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:22.229111 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.229026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn986\" (UniqueName: \"kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986\") pod \"authorino-75d556bd77-rxd77\" (UID: \"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3\") " pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:22.236879 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.236861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:22.330288 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.330258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn986\" (UniqueName: \"kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986\") pod \"authorino-75d556bd77-rxd77\" (UID: \"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3\") " pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:22.339117 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.339087 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn986\" (UniqueName: \"kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986\") pod \"authorino-75d556bd77-rxd77\" (UID: \"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3\") " pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:22.360527 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.360495 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:22.367064 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.367045 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:22.370361 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:22.370335 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fb97bc4_0591_4383_9fd1_1d9f3453cd5b.slice/crio-f40df9fa20320b031c5332c03f56c953c9a40c881d5243e34930b47aefe676ce WatchSource:0}: Error finding container f40df9fa20320b031c5332c03f56c953c9a40c881d5243e34930b47aefe676ce: Status 404 returned error can't find the container with id f40df9fa20320b031c5332c03f56c953c9a40c881d5243e34930b47aefe676ce Jul 16 20:41:22.492344 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.492321 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:22.494266 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:22.494242 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bde4c2f_8e78_4448_ab5a_cbbdbdcbe0f3.slice/crio-0c9c90e1bfbbcab12181d9cb95d954438cfa6ba06dc4599afa9302b4d6024efa WatchSource:0}: Error finding container 0c9c90e1bfbbcab12181d9cb95d954438cfa6ba06dc4599afa9302b4d6024efa: Status 404 returned error can't find the container with id 0c9c90e1bfbbcab12181d9cb95d954438cfa6ba06dc4599afa9302b4d6024efa Jul 16 20:41:22.781557 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.781455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vw64m" event={"ID":"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b","Type":"ContainerStarted","Data":"f40df9fa20320b031c5332c03f56c953c9a40c881d5243e34930b47aefe676ce"} Jul 16 20:41:22.782569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:22.782544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rxd77" event={"ID":"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3","Type":"ContainerStarted","Data":"0c9c90e1bfbbcab12181d9cb95d954438cfa6ba06dc4599afa9302b4d6024efa"} Jul 16 20:41:25.801434 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:25.801397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rxd77" event={"ID":"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3","Type":"ContainerStarted","Data":"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a"} Jul 16 20:41:25.802940 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:25.802895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vw64m" event={"ID":"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b","Type":"ContainerStarted","Data":"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd"} Jul 16 20:41:25.816569 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:25.816516 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rxd77" podStartSLOduration=1.068567732 podStartE2EDuration="3.816493092s" totalImagesPullingTime="2.74792536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:41:25.816314294 +0000 UTC m=+509.075273742" watchObservedRunningTime="2026-07-16 20:41:25.816493092 +0000 UTC m=+509.075452543" Jul 16 20:41:25.833894 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:25.833847 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vw64m" podStartSLOduration=1.962477277 podStartE2EDuration="4.833831128s" totalImagesPullingTime="2.871353851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:41:25.831394926 +0000 UTC m=+509.090354397" watchObservedRunningTime="2026-07-16 20:41:25.833831128 +0000 UTC m=+509.092790600" Jul 16 20:41:25.858914 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:25.858859 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:27.814625 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:27.814574 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vw64m" podUID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" containerName="authorino" containerID="cri-o://d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd" gracePeriod=30 Jul 16 20:41:28.067178 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.067118 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:28.185679 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.185642 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hb5q\" (UniqueName: \"kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q\") pod \"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b\" (UID: \"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b\") " Jul 16 20:41:28.188057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.188023 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q" (OuterVolumeSpecName: "kube-api-access-7hb5q") pod "3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" (UID: "3fb97bc4-0591-4383-9fd1-1d9f3453cd5b"). InnerVolumeSpecName "kube-api-access-7hb5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:28.286713 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.286683 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hb5q\" (UniqueName: \"kubernetes.io/projected/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b-kube-api-access-7hb5q\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:28.820786 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.820750 2563 generic.go:356] "Generic (PLEG): container finished" podID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" containerID="d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd" exitCode=0 Jul 16 20:41:28.821250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.820793 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vw64m" Jul 16 20:41:28.821250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.820831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vw64m" event={"ID":"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b","Type":"ContainerDied","Data":"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd"} Jul 16 20:41:28.821250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.820877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vw64m" event={"ID":"3fb97bc4-0591-4383-9fd1-1d9f3453cd5b","Type":"ContainerDied","Data":"f40df9fa20320b031c5332c03f56c953c9a40c881d5243e34930b47aefe676ce"} Jul 16 20:41:28.821250 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.820918 2563 scope.go:117] "RemoveContainer" containerID="d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd" Jul 16 20:41:28.830431 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.830413 2563 scope.go:117] "RemoveContainer" containerID="d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd" Jul 16 20:41:28.830696 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:41:28.830678 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd\": container with ID starting with d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd not found: ID does not exist" containerID="d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd" Jul 16 20:41:28.830748 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.830705 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd"} err="failed to get container status \"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd\": rpc error: code = NotFound desc = could not find container \"d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd\": container with ID starting with d7685e8a0737536017e73af985c6adbd0639e68c4c4bacfb95a8fcc841d6c1bd not found: ID does not exist" Jul 16 20:41:28.843060 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.843031 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:28.846490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:28.846467 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vw64m"] Jul 16 20:41:29.261107 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:29.261078 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" path="/var/lib/kubelet/pods/3fb97bc4-0591-4383-9fd1-1d9f3453cd5b/volumes" Jul 16 20:41:37.306646 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:37.306609 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:37.395944 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:37.395855 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:37.827411 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:37.827375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:40.865199 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:40.865163 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:49.970743 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:49.970661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:50.198406 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.198375 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:50.198783 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.198772 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" containerName="authorino" Jul 16 20:41:50.198836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.198786 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" containerName="authorino" Jul 16 20:41:50.198871 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.198842 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb97bc4-0591-4383-9fd1-1d9f3453cd5b" containerName="authorino" Jul 16 20:41:50.201684 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.201668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:50.209013 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.208724 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:50.274994 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.274882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgvz\" (UniqueName: \"kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz\") pod \"authorino-5d4b67c446-k5tdf\" (UID: \"23558872-df21-4072-8a9e-80b8bbcfc811\") " pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:50.308241 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.308213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:50.375426 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.375385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgvz\" (UniqueName: \"kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz\") pod \"authorino-5d4b67c446-k5tdf\" (UID: \"23558872-df21-4072-8a9e-80b8bbcfc811\") " pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:50.383777 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.383751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgvz\" (UniqueName: \"kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz\") pod \"authorino-5d4b67c446-k5tdf\" (UID: \"23558872-df21-4072-8a9e-80b8bbcfc811\") " pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:50.431387 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.431359 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:50.431629 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.431617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:50.455645 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.455618 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f4b5c6d8c-nnkfg"] Jul 16 20:41:50.460383 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.460363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:50.465427 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.465404 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4b5c6d8c-nnkfg"] Jul 16 20:41:50.571691 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.571668 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:50.574270 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:50.574232 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23558872_df21_4072_8a9e_80b8bbcfc811.slice/crio-714a5214d9b92b12a91e5f506ed07ade14abb38aac32109c134944b0572c3aa9 WatchSource:0}: Error finding container 714a5214d9b92b12a91e5f506ed07ade14abb38aac32109c134944b0572c3aa9: Status 404 returned error can't find the container with id 714a5214d9b92b12a91e5f506ed07ade14abb38aac32109c134944b0572c3aa9 Jul 16 20:41:50.577259 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.577234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fpg\" (UniqueName: \"kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg\") pod \"authorino-f4b5c6d8c-nnkfg\" (UID: \"bd8671db-e964-4d0c-8c51-5d67a92ef59b\") " pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:50.659449 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.659416 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f4b5c6d8c-nnkfg"] Jul 16 20:41:50.659705 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:41:50.659686 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-74fpg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" podUID="bd8671db-e964-4d0c-8c51-5d67a92ef59b" Jul 16 20:41:50.678503 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.678467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fpg\" (UniqueName: \"kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg\") pod \"authorino-f4b5c6d8c-nnkfg\" (UID: \"bd8671db-e964-4d0c-8c51-5d67a92ef59b\") " pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:50.685830 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.685809 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:41:50.689364 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.689350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.691716 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.691690 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 16 20:41:50.694215 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.694197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fpg\" (UniqueName: \"kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg\") pod \"authorino-f4b5c6d8c-nnkfg\" (UID: \"bd8671db-e964-4d0c-8c51-5d67a92ef59b\") " pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:50.695794 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.695774 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:41:50.779332 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.779301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.779482 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.779409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9ls\" (UniqueName: \"kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.880019 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.879949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9ls\" (UniqueName: \"kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.880019 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.879998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.882497 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.882477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.887306 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.887286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9ls\" (UniqueName: \"kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls\") pod \"authorino-56f4d4fbf9-h47fv\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:50.945536 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.945508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" event={"ID":"23558872-df21-4072-8a9e-80b8bbcfc811","Type":"ContainerStarted","Data":"714a5214d9b92b12a91e5f506ed07ade14abb38aac32109c134944b0572c3aa9"} Jul 16 20:41:50.945536 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.945523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:50.952107 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:50.952090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:51.007652 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.007622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:41:51.081468 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.081445 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74fpg\" (UniqueName: \"kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg\") pod \"bd8671db-e964-4d0c-8c51-5d67a92ef59b\" (UID: \"bd8671db-e964-4d0c-8c51-5d67a92ef59b\") " Jul 16 20:41:51.083469 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.083443 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg" (OuterVolumeSpecName: "kube-api-access-74fpg") pod "bd8671db-e964-4d0c-8c51-5d67a92ef59b" (UID: "bd8671db-e964-4d0c-8c51-5d67a92ef59b"). InnerVolumeSpecName "kube-api-access-74fpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:51.143731 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.143705 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:41:51.145486 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:51.145447 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bcc0cee_8f31_457c_81c8_eb5e855fb48c.slice/crio-08cb19986790d6bf3b1c526f3b03796c8da9a54ec27a21c02d7472e831b720c4 WatchSource:0}: Error finding container 08cb19986790d6bf3b1c526f3b03796c8da9a54ec27a21c02d7472e831b720c4: Status 404 returned error can't find the container with id 08cb19986790d6bf3b1c526f3b03796c8da9a54ec27a21c02d7472e831b720c4 Jul 16 20:41:51.182628 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.182586 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74fpg\" (UniqueName: \"kubernetes.io/projected/bd8671db-e964-4d0c-8c51-5d67a92ef59b-kube-api-access-74fpg\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:51.952080 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.952042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" event={"ID":"23558872-df21-4072-8a9e-80b8bbcfc811","Type":"ContainerStarted","Data":"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675"} Jul 16 20:41:51.952264 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.952106 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" podUID="23558872-df21-4072-8a9e-80b8bbcfc811" containerName="authorino" containerID="cri-o://6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675" gracePeriod=30 Jul 16 20:41:51.953351 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.953328 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" event={"ID":"6bcc0cee-8f31-457c-81c8-eb5e855fb48c","Type":"ContainerStarted","Data":"08cb19986790d6bf3b1c526f3b03796c8da9a54ec27a21c02d7472e831b720c4"} Jul 16 20:41:51.953466 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.953404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4b5c6d8c-nnkfg" Jul 16 20:41:51.967589 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.967549 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" podStartSLOduration=1.5107198990000001 podStartE2EDuration="1.967535531s" totalImagesPullingTime="456.815632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:41:51.966809194 +0000 UTC m=+535.225768644" watchObservedRunningTime="2026-07-16 20:41:51.967535531 +0000 UTC m=+535.226494980" Jul 16 20:41:51.990805 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.990779 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f4b5c6d8c-nnkfg"] Jul 16 20:41:51.992750 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:51.992731 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f4b5c6d8c-nnkfg"] Jul 16 20:41:52.197377 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.197352 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:52.293182 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.293094 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmgvz\" (UniqueName: \"kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz\") pod \"23558872-df21-4072-8a9e-80b8bbcfc811\" (UID: \"23558872-df21-4072-8a9e-80b8bbcfc811\") " Jul 16 20:41:52.295441 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.295410 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz" (OuterVolumeSpecName: "kube-api-access-bmgvz") pod "23558872-df21-4072-8a9e-80b8bbcfc811" (UID: "23558872-df21-4072-8a9e-80b8bbcfc811"). InnerVolumeSpecName "kube-api-access-bmgvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:52.393927 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.393872 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmgvz\" (UniqueName: \"kubernetes.io/projected/23558872-df21-4072-8a9e-80b8bbcfc811-kube-api-access-bmgvz\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:52.959700 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.959664 2563 generic.go:356] "Generic (PLEG): container finished" podID="23558872-df21-4072-8a9e-80b8bbcfc811" containerID="6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675" exitCode=0 Jul 16 20:41:52.959929 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.959714 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" Jul 16 20:41:52.959929 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.959746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" event={"ID":"23558872-df21-4072-8a9e-80b8bbcfc811","Type":"ContainerDied","Data":"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675"} Jul 16 20:41:52.959929 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.959786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5tdf" event={"ID":"23558872-df21-4072-8a9e-80b8bbcfc811","Type":"ContainerDied","Data":"714a5214d9b92b12a91e5f506ed07ade14abb38aac32109c134944b0572c3aa9"} Jul 16 20:41:52.959929 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.959803 2563 scope.go:117] "RemoveContainer" containerID="6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675" Jul 16 20:41:52.969287 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.969195 2563 scope.go:117] "RemoveContainer" containerID="6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675" Jul 16 20:41:52.969456 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:41:52.969439 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675\": container with ID starting with 6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675 not found: ID does not exist" containerID="6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675" Jul 16 20:41:52.969500 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.969464 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675"} err="failed to get container status \"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675\": rpc error: code = NotFound desc = could not find container \"6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675\": container with ID starting with 6035b93a1a3b79b30707f8eec8198ca46edd57f662a4ef6ff6f3b35e20d78675 not found: ID does not exist" Jul 16 20:41:52.980474 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.980450 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:52.984360 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:52.984340 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5tdf"] Jul 16 20:41:53.265516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:53.261780 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23558872-df21-4072-8a9e-80b8bbcfc811" path="/var/lib/kubelet/pods/23558872-df21-4072-8a9e-80b8bbcfc811/volumes" Jul 16 20:41:53.265516 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:53.262331 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd8671db-e964-4d0c-8c51-5d67a92ef59b" path="/var/lib/kubelet/pods/bd8671db-e964-4d0c-8c51-5d67a92ef59b/volumes" Jul 16 20:41:53.966563 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:53.966525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" event={"ID":"6bcc0cee-8f31-457c-81c8-eb5e855fb48c","Type":"ContainerStarted","Data":"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f"} Jul 16 20:41:53.982781 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:53.982732 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" podStartSLOduration=1.712805363 podStartE2EDuration="3.982717068s" totalImagesPullingTime="2.269911705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:41:53.981273747 +0000 UTC m=+537.240233197" watchObservedRunningTime="2026-07-16 20:41:53.982717068 +0000 UTC m=+537.241676517" Jul 16 20:41:54.011875 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.011843 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:54.012063 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.012023 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rxd77" podUID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" containerName="authorino" containerID="cri-o://b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a" gracePeriod=30 Jul 16 20:41:54.252615 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.252591 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:54.313024 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.312993 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn986\" (UniqueName: \"kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986\") pod \"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3\" (UID: \"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3\") " Jul 16 20:41:54.315159 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.315135 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986" (OuterVolumeSpecName: "kube-api-access-dn986") pod "4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" (UID: "4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3"). InnerVolumeSpecName "kube-api-access-dn986". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:41:54.414359 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.414323 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn986\" (UniqueName: \"kubernetes.io/projected/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3-kube-api-access-dn986\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:41:54.974090 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.974055 2563 generic.go:356] "Generic (PLEG): container finished" podID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" containerID="b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a" exitCode=0 Jul 16 20:41:54.974090 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.974095 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rxd77" Jul 16 20:41:54.974283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.974140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rxd77" event={"ID":"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3","Type":"ContainerDied","Data":"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a"} Jul 16 20:41:54.974283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.974173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rxd77" event={"ID":"4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3","Type":"ContainerDied","Data":"0c9c90e1bfbbcab12181d9cb95d954438cfa6ba06dc4599afa9302b4d6024efa"} Jul 16 20:41:54.974283 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.974191 2563 scope.go:117] "RemoveContainer" containerID="b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a" Jul 16 20:41:54.983837 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.983820 2563 scope.go:117] "RemoveContainer" containerID="b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a" Jul 16 20:41:54.984090 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:41:54.984072 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a\": container with ID starting with b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a not found: ID does not exist" containerID="b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a" Jul 16 20:41:54.984180 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.984097 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a"} err="failed to get container status \"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a\": rpc error: code = NotFound desc = could not find container \"b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a\": container with ID starting with b6c62b98e3d900dbc4cf47ae76d1cadc43529c67cd59be783b91b5911da1180a not found: ID does not exist" Jul 16 20:41:54.996799 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:54.996776 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:55.002773 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:55.002754 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rxd77"] Jul 16 20:41:55.263490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:55.263390 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" path="/var/lib/kubelet/pods/4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3/volumes" Jul 16 20:41:58.692529 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.692469 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:58.706807 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.706776 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:41:58.707196 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707181 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" containerName="authorino" Jul 16 20:41:58.707251 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707198 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" containerName="authorino" Jul 16 20:41:58.707251 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707218 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23558872-df21-4072-8a9e-80b8bbcfc811" containerName="authorino" Jul 16 20:41:58.707251 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707224 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23558872-df21-4072-8a9e-80b8bbcfc811" containerName="authorino" Jul 16 20:41:58.707353 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707283 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="23558872-df21-4072-8a9e-80b8bbcfc811" containerName="authorino" Jul 16 20:41:58.707353 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.707291 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bde4c2f-8e78-4448-ab5a-cbbdbdcbe0f3" containerName="authorino" Jul 16 20:41:58.711840 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.711816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.714604 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.714581 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6jqml\"" Jul 16 20:41:58.714733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.714644 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:41:58.714804 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.714599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:41:58.721480 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.721342 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:41:58.789472 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.789431 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:58.857279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.857244 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.857452 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.857292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4ct\" (UniqueName: \"kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.870922 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.870859 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:41:58.875470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.875446 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:41:58.877785 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.877770 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:58.886852 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.886829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:41:58.958353 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.958275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:58.958353 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.958322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ng6l\" (UniqueName: \"kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:58.958575 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.958355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.958575 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.958419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4ct\" (UniqueName: \"kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.960854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.960835 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:58.965805 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:58.965785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4ct\" (UniqueName: \"kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct\") pod \"maas-controller-d5c6754cb-w285b\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:59.026052 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.026022 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:41:59.059769 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.059734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ng6l\" (UniqueName: \"kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:59.059951 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.059867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:59.062384 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.062362 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:59.068114 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.068090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ng6l\" (UniqueName: \"kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l\") pod \"maas-controller-54cbbd8d77-lmvp2\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:59.162487 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.162461 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:41:59.163990 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:59.163961 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f695315_182e_4e5f_9fe8_1f7c0282205f.slice/crio-b41c85d92b5913d48b4a56420e02cba498dd382b6955cd1de4b951731d7ea0aa WatchSource:0}: Error finding container b41c85d92b5913d48b4a56420e02cba498dd382b6955cd1de4b951731d7ea0aa: Status 404 returned error can't find the container with id b41c85d92b5913d48b4a56420e02cba498dd382b6955cd1de4b951731d7ea0aa Jul 16 20:41:59.188613 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.188588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:41:59.318588 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:41:59.318565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:41:59.320336 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:41:59.320305 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f993a0c_7698_424d_8e40_2453389d7c7e.slice/crio-ac7a56157d3ecbeff7934ba71bf3b2fd1a165e2b7a5d44e71051766694241a41 WatchSource:0}: Error finding container ac7a56157d3ecbeff7934ba71bf3b2fd1a165e2b7a5d44e71051766694241a41: Status 404 returned error can't find the container with id ac7a56157d3ecbeff7934ba71bf3b2fd1a165e2b7a5d44e71051766694241a41 Jul 16 20:42:00.014106 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:00.013812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" event={"ID":"1f993a0c-7698-424d-8e40-2453389d7c7e","Type":"ContainerStarted","Data":"ac7a56157d3ecbeff7934ba71bf3b2fd1a165e2b7a5d44e71051766694241a41"} Jul 16 20:42:00.016287 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:00.016205 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5c6754cb-w285b" event={"ID":"3f695315-182e-4e5f-9fe8-1f7c0282205f","Type":"ContainerStarted","Data":"b41c85d92b5913d48b4a56420e02cba498dd382b6955cd1de4b951731d7ea0aa"} Jul 16 20:42:02.005051 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.005006 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:02.031248 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.031212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" event={"ID":"1f993a0c-7698-424d-8e40-2453389d7c7e","Type":"ContainerStarted","Data":"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02"} Jul 16 20:42:02.031435 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.031348 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:42:02.032700 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.032677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5c6754cb-w285b" event={"ID":"3f695315-182e-4e5f-9fe8-1f7c0282205f","Type":"ContainerStarted","Data":"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993"} Jul 16 20:42:02.032801 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.032739 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:42:02.050306 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.050187 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" podStartSLOduration=1.576094997 podStartE2EDuration="4.050173877s" totalImagesPullingTime="2.47407888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:42:02.048529503 +0000 UTC m=+545.307488944" watchObservedRunningTime="2026-07-16 20:42:02.050173877 +0000 UTC m=+545.309133326" Jul 16 20:42:02.069040 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.068996 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d5c6754cb-w285b" podStartSLOduration=1.428102222 podStartE2EDuration="4.068981232s" totalImagesPullingTime="2.64087901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:42:02.066523363 +0000 UTC m=+545.325482816" watchObservedRunningTime="2026-07-16 20:42:02.068981232 +0000 UTC m=+545.327940680" Jul 16 20:42:02.103590 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:02.103555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:13.040851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.040818 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:42:13.041389 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.040899 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:42:13.100210 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.100178 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:42:13.100520 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.100483 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d5c6754cb-w285b" podUID="3f695315-182e-4e5f-9fe8-1f7c0282205f" containerName="manager" containerID="cri-o://a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993" gracePeriod=30 Jul 16 20:42:13.353293 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.353268 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:42:13.491121 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.491084 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk4ct\" (UniqueName: \"kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct\") pod \"3f695315-182e-4e5f-9fe8-1f7c0282205f\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " Jul 16 20:42:13.491121 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.491127 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert\") pod \"3f695315-182e-4e5f-9fe8-1f7c0282205f\" (UID: \"3f695315-182e-4e5f-9fe8-1f7c0282205f\") " Jul 16 20:42:13.493490 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.493463 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct" (OuterVolumeSpecName: "kube-api-access-bk4ct") pod "3f695315-182e-4e5f-9fe8-1f7c0282205f" (UID: "3f695315-182e-4e5f-9fe8-1f7c0282205f"). InnerVolumeSpecName "kube-api-access-bk4ct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:42:13.493607 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.493494 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3f695315-182e-4e5f-9fe8-1f7c0282205f" (UID: "3f695315-182e-4e5f-9fe8-1f7c0282205f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:42:13.592417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.592328 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk4ct\" (UniqueName: \"kubernetes.io/projected/3f695315-182e-4e5f-9fe8-1f7c0282205f-kube-api-access-bk4ct\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:42:13.592417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:13.592361 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f695315-182e-4e5f-9fe8-1f7c0282205f-webhook-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:42:14.098479 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.098442 2563 generic.go:356] "Generic (PLEG): container finished" podID="3f695315-182e-4e5f-9fe8-1f7c0282205f" containerID="a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993" exitCode=0 Jul 16 20:42:14.098479 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.098483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5c6754cb-w285b" event={"ID":"3f695315-182e-4e5f-9fe8-1f7c0282205f","Type":"ContainerDied","Data":"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993"} Jul 16 20:42:14.099001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.098502 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d5c6754cb-w285b" Jul 16 20:42:14.099001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.098550 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d5c6754cb-w285b" event={"ID":"3f695315-182e-4e5f-9fe8-1f7c0282205f","Type":"ContainerDied","Data":"b41c85d92b5913d48b4a56420e02cba498dd382b6955cd1de4b951731d7ea0aa"} Jul 16 20:42:14.099001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.098575 2563 scope.go:117] "RemoveContainer" containerID="a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993" Jul 16 20:42:14.108051 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.107951 2563 scope.go:117] "RemoveContainer" containerID="a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993" Jul 16 20:42:14.108229 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:42:14.108210 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993\": container with ID starting with a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993 not found: ID does not exist" containerID="a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993" Jul 16 20:42:14.108269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.108238 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993"} err="failed to get container status \"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993\": rpc error: code = NotFound desc = could not find container \"a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993\": container with ID starting with a8b2d635565d106c73310542578864da16b10e70394915f2cc06673b0a999993 not found: ID does not exist" Jul 16 20:42:14.130956 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.130924 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:42:14.135700 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:14.135675 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d5c6754cb-w285b"] Jul 16 20:42:15.260309 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:15.260276 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f695315-182e-4e5f-9fe8-1f7c0282205f" path="/var/lib/kubelet/pods/3f695315-182e-4e5f-9fe8-1f7c0282205f/volumes" Jul 16 20:42:34.007456 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.007420 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:34.842390 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.842351 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fxvvj"] Jul 16 20:42:34.842726 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.842714 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f695315-182e-4e5f-9fe8-1f7c0282205f" containerName="manager" Jul 16 20:42:34.842778 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.842728 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f695315-182e-4e5f-9fe8-1f7c0282205f" containerName="manager" Jul 16 20:42:34.842821 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.842798 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f695315-182e-4e5f-9fe8-1f7c0282205f" containerName="manager" Jul 16 20:42:34.847538 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.847517 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.849979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.849960 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 20:42:34.856843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.856822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fxvvj"] Jul 16 20:42:34.879800 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.879767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8535c133-28d1-43dd-b79b-3eca4f791a26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.879972 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.879834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq85s\" (UniqueName: \"kubernetes.io/projected/8535c133-28d1-43dd-b79b-3eca4f791a26-kube-api-access-wq85s\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.980836 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.980805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8535c133-28d1-43dd-b79b-3eca4f791a26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.981035 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.980854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq85s\" (UniqueName: \"kubernetes.io/projected/8535c133-28d1-43dd-b79b-3eca4f791a26-kube-api-access-wq85s\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.981549 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.981529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8535c133-28d1-43dd-b79b-3eca4f791a26-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:34.989472 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:34.989442 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq85s\" (UniqueName: \"kubernetes.io/projected/8535c133-28d1-43dd-b79b-3eca4f791a26-kube-api-access-wq85s\") pod \"payload-pre-processing-7677b774bb-fxvvj\" (UID: \"8535c133-28d1-43dd-b79b-3eca4f791a26\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:35.158817 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:35.158781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:35.295780 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:35.295753 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fxvvj"] Jul 16 20:42:35.298009 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:42:35.297982 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8535c133_28d1_43dd_b79b_3eca4f791a26.slice/crio-0e3013a1b0ff8a90526c2baa551b79c68ad660072734dc3668799ef080df7d2d WatchSource:0}: Error finding container 0e3013a1b0ff8a90526c2baa551b79c68ad660072734dc3668799ef080df7d2d: Status 404 returned error can't find the container with id 0e3013a1b0ff8a90526c2baa551b79c68ad660072734dc3668799ef080df7d2d Jul 16 20:42:36.164208 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:36.164173 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:36.217995 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:36.217959 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" event={"ID":"8535c133-28d1-43dd-b79b-3eca4f791a26","Type":"ContainerStarted","Data":"0e3013a1b0ff8a90526c2baa551b79c68ad660072734dc3668799ef080df7d2d"} Jul 16 20:42:42.250950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:42.250890 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" event={"ID":"8535c133-28d1-43dd-b79b-3eca4f791a26","Type":"ContainerStarted","Data":"e89e12c425adf240adceaec21eb2ca8d9aca6687c56273108cefd74b5e957954"} Jul 16 20:42:42.251309 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:42.251033 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:42.267197 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:42.267149 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" podStartSLOduration=1.908029432 podStartE2EDuration="8.267135887s" totalImagesPullingTime="6.359106455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:42:42.266153099 +0000 UTC m=+585.525112560" watchObservedRunningTime="2026-07-16 20:42:42.267135887 +0000 UTC m=+585.526095336" Jul 16 20:42:45.837987 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:45.837950 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:45.938123 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:45.938082 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:42:53.260328 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:53.260299 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fxvvj" Jul 16 20:42:57.157218 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:57.157191 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:42:57.157652 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:42:57.157222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:43:00.533139 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:00.533107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:12.078843 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.078806 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm"] Jul 16 20:43:12.082522 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.082503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.086149 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.086127 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2ztqv\"" Jul 16 20:43:12.086290 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.086162 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 20:43:12.086290 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.086188 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 20:43:12.086290 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.086162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 16 20:43:12.091459 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.091436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm"] Jul 16 20:43:12.099417 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.099527 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46glv\" (UniqueName: \"kubernetes.io/projected/838683f3-a874-4c8f-a2c2-ed9a2003d779-kube-api-access-46glv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.099527 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.099598 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.099598 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838683f3-a874-4c8f-a2c2-ed9a2003d779-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.099667 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.099635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.177300 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.177270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:12.200439 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46glv\" (UniqueName: \"kubernetes.io/projected/838683f3-a874-4c8f-a2c2-ed9a2003d779-kube-api-access-46glv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838683f3-a874-4c8f-a2c2-ed9a2003d779-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200555 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200788 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.200898 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.201002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200952 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.201002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.200993 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.202928 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.202876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838683f3-a874-4c8f-a2c2-ed9a2003d779-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.203064 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.203044 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838683f3-a874-4c8f-a2c2-ed9a2003d779-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.208750 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.208732 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46glv\" (UniqueName: \"kubernetes.io/projected/838683f3-a874-4c8f-a2c2-ed9a2003d779-kube-api-access-46glv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96pm\" (UID: \"838683f3-a874-4c8f-a2c2-ed9a2003d779\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.394072 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.394038 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:12.533420 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.533378 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm"] Jul 16 20:43:12.537251 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:43:12.537221 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838683f3_a874_4c8f_a2c2_ed9a2003d779.slice/crio-7bd158a30ffcefb8c551db1be4a5e14c328307ef42d13e631b44d809f85cb1b5 WatchSource:0}: Error finding container 7bd158a30ffcefb8c551db1be4a5e14c328307ef42d13e631b44d809f85cb1b5: Status 404 returned error can't find the container with id 7bd158a30ffcefb8c551db1be4a5e14c328307ef42d13e631b44d809f85cb1b5 Jul 16 20:43:12.538335 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:12.538309 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 20:43:13.424792 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:13.424721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" event={"ID":"838683f3-a874-4c8f-a2c2-ed9a2003d779","Type":"ContainerStarted","Data":"7bd158a30ffcefb8c551db1be4a5e14c328307ef42d13e631b44d809f85cb1b5"} Jul 16 20:43:14.432276 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:14.432238 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" event={"ID":"838683f3-a874-4c8f-a2c2-ed9a2003d779","Type":"ContainerStarted","Data":"5f22ec1ec137dfb0fa0cbf174ba9cffb3ffa2291338bf7e67eee0e70a8da99b9"} Jul 16 20:43:14.451024 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:14.450972 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" podStartSLOduration=1.361841814 podStartE2EDuration="2.450956855s" totalImagesPullingTime="1.089115041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:43:14.448385701 +0000 UTC m=+617.707345152" watchObservedRunningTime="2026-07-16 20:43:14.450956855 +0000 UTC m=+617.709916339" Jul 16 20:43:22.394976 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:22.394870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:22.394976 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:22.394957 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:22.407545 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:22.407519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:22.485351 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:22.485324 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96pm" Jul 16 20:43:29.887379 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.887343 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s"] Jul 16 20:43:29.890887 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.890866 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.893639 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.893620 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 20:43:29.900670 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.900645 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s"] Jul 16 20:43:29.957588 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.957767 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.957767 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg2s9\" (UniqueName: \"kubernetes.io/projected/bf189063-2162-4f79-abe5-3767a00e5231-kube-api-access-gg2s9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.957767 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf189063-2162-4f79-abe5-3767a00e5231-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.957877 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.957877 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.957810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:29.984102 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:29.984063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:43:30.059170 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg2s9\" (UniqueName: \"kubernetes.io/projected/bf189063-2162-4f79-abe5-3767a00e5231-kube-api-access-gg2s9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf189063-2162-4f79-abe5-3767a00e5231-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059371 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059618 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059586 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059691 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.059771 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.059754 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.061893 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.061868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf189063-2162-4f79-abe5-3767a00e5231-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.062044 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.062028 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf189063-2162-4f79-abe5-3767a00e5231-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.068262 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.068238 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg2s9\" (UniqueName: \"kubernetes.io/projected/bf189063-2162-4f79-abe5-3767a00e5231-kube-api-access-gg2s9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl58s\" (UID: \"bf189063-2162-4f79-abe5-3767a00e5231\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.201924 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.201810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:30.339476 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.339441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s"] Jul 16 20:43:30.341827 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:43:30.341799 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf189063_2162_4f79_abe5_3767a00e5231.slice/crio-ff0945ff2d18e39df830a31f6cc901b4e8babc8314d98a2245143502c0ead62c WatchSource:0}: Error finding container ff0945ff2d18e39df830a31f6cc901b4e8babc8314d98a2245143502c0ead62c: Status 404 returned error can't find the container with id ff0945ff2d18e39df830a31f6cc901b4e8babc8314d98a2245143502c0ead62c Jul 16 20:43:30.518226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:30.518131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" event={"ID":"bf189063-2162-4f79-abe5-3767a00e5231","Type":"ContainerStarted","Data":"ff0945ff2d18e39df830a31f6cc901b4e8babc8314d98a2245143502c0ead62c"} Jul 16 20:43:31.526233 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:31.526197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" event={"ID":"bf189063-2162-4f79-abe5-3767a00e5231","Type":"ContainerStarted","Data":"4fb66814a7b0f3945e733783b2e87634bc7b94edc7f1761cd858d0c8093779a6"} Jul 16 20:43:31.556305 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:31.556251 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" podStartSLOduration=2.346857084 podStartE2EDuration="2.556232951s" totalImagesPullingTime="209.375867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:43:31.554381364 +0000 UTC m=+634.813340815" watchObservedRunningTime="2026-07-16 20:43:31.556232951 +0000 UTC m=+634.815192399" Jul 16 20:43:40.202659 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:40.202614 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:40.203080 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:40.202688 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:40.215181 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:40.215156 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:40.584841 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:40.584755 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl58s" Jul 16 20:43:49.450328 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:43:49.450292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:08.150065 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.150023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr"] Jul 16 20:44:08.153576 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.153557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.158018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.157999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 16 20:44:08.178311 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.178281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr"] Jul 16 20:44:08.206109 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.206223 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9254cd-9cce-4160-8e62-78694f5d7d67-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.206223 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.206324 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mdz\" (UniqueName: \"kubernetes.io/projected/de9254cd-9cce-4160-8e62-78694f5d7d67-kube-api-access-f2mdz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.206324 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.206324 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.206296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.276328 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.276304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:08.306663 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.306768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9254cd-9cce-4160-8e62-78694f5d7d67-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.306768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.306768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mdz\" (UniqueName: \"kubernetes.io/projected/de9254cd-9cce-4160-8e62-78694f5d7d67-kube-api-access-f2mdz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.306768 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.307012 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.306815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.307193 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.307169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.307267 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.307215 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.307267 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.307246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.309168 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.309150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de9254cd-9cce-4160-8e62-78694f5d7d67-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.309443 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.309424 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de9254cd-9cce-4160-8e62-78694f5d7d67-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.320096 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.320076 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mdz\" (UniqueName: \"kubernetes.io/projected/de9254cd-9cce-4160-8e62-78694f5d7d67-kube-api-access-f2mdz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zrrcr\" (UID: \"de9254cd-9cce-4160-8e62-78694f5d7d67\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.463463 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.463400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:08.635917 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.635880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr"] Jul 16 20:44:08.636880 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:44:08.636857 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9254cd_9cce_4160_8e62_78694f5d7d67.slice/crio-54d30a49a2b42e2f70ccf1ea17098ad2ddbf7973fdccd7441f406ca6a03f4d1a WatchSource:0}: Error finding container 54d30a49a2b42e2f70ccf1ea17098ad2ddbf7973fdccd7441f406ca6a03f4d1a: Status 404 returned error can't find the container with id 54d30a49a2b42e2f70ccf1ea17098ad2ddbf7973fdccd7441f406ca6a03f4d1a Jul 16 20:44:08.720546 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:08.720467 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" event={"ID":"de9254cd-9cce-4160-8e62-78694f5d7d67","Type":"ContainerStarted","Data":"54d30a49a2b42e2f70ccf1ea17098ad2ddbf7973fdccd7441f406ca6a03f4d1a"} Jul 16 20:44:09.727577 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:09.727541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" event={"ID":"de9254cd-9cce-4160-8e62-78694f5d7d67","Type":"ContainerStarted","Data":"1f832c5425309cf2e9ac306cf5f54e0a82914a8df4928fd5cca61c559ff648bb"} Jul 16 20:44:09.775737 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:09.775693 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" podStartSLOduration=1.5826096440000001 podStartE2EDuration="1.775677146s" totalImagesPullingTime="193.067502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:44:09.775138932 +0000 UTC m=+673.034098395" watchObservedRunningTime="2026-07-16 20:44:09.775677146 +0000 UTC m=+673.034636645" Jul 16 20:44:14.921376 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:14.921343 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:18.464009 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:18.463958 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:18.464009 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:18.464030 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:18.476610 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:18.476587 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:18.790279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:18.790197 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zrrcr" Jul 16 20:44:50.796346 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:50.796235 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:44:50.857634 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:44:50.857599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:00.161535 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.161497 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk"] Jul 16 20:45:00.164985 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.164969 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" Jul 16 20:45:00.167939 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.167918 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hb99\"" Jul 16 20:45:00.173002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.172873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk"] Jul 16 20:45:00.176111 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.176093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" Jul 16 20:45:00.321658 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:00.321630 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk"] Jul 16 20:45:00.323807 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:45:00.323782 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba19cc8b_1963_4856_bb52_b2efd497b1da.slice/crio-11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368 WatchSource:0}: Error finding container 11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368: Status 404 returned error can't find the container with id 11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368 Jul 16 20:45:01.003737 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:01.003703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" event={"ID":"ba19cc8b-1963-4856-bb52-b2efd497b1da","Type":"ContainerStarted","Data":"11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368"} Jul 16 20:45:03.367137 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.367097 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59568f5c74-dxl29"] Jul 16 20:45:03.370853 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.370828 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.399693 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.399665 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59568f5c74-dxl29"] Jul 16 20:45:03.524828 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.524790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72648fa1-677d-4d9f-9104-eec80532b941-tls-cert\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.525046 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.524844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs9cf\" (UniqueName: \"kubernetes.io/projected/72648fa1-677d-4d9f-9104-eec80532b941-kube-api-access-zs9cf\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.625758 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.625675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72648fa1-677d-4d9f-9104-eec80532b941-tls-cert\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.625758 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.625721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs9cf\" (UniqueName: \"kubernetes.io/projected/72648fa1-677d-4d9f-9104-eec80532b941-kube-api-access-zs9cf\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.628476 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.628450 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72648fa1-677d-4d9f-9104-eec80532b941-tls-cert\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.636402 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.636363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs9cf\" (UniqueName: \"kubernetes.io/projected/72648fa1-677d-4d9f-9104-eec80532b941-kube-api-access-zs9cf\") pod \"authorino-59568f5c74-dxl29\" (UID: \"72648fa1-677d-4d9f-9104-eec80532b941\") " pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.681950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.681919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59568f5c74-dxl29" Jul 16 20:45:03.782290 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.782255 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:03.870508 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:03.870454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:04.304050 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:04.304019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59568f5c74-dxl29"] Jul 16 20:45:04.305075 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:45:04.305047 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72648fa1_677d_4d9f_9104_eec80532b941.slice/crio-fe74ebaebce807a1924e5e24ee57e0ead84581f84ea37d95b0c979b5994dba11 WatchSource:0}: Error finding container fe74ebaebce807a1924e5e24ee57e0ead84581f84ea37d95b0c979b5994dba11: Status 404 returned error can't find the container with id fe74ebaebce807a1924e5e24ee57e0ead84581f84ea37d95b0c979b5994dba11 Jul 16 20:45:04.893407 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:04.893369 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:05.030655 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.030611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" event={"ID":"ba19cc8b-1963-4856-bb52-b2efd497b1da","Type":"ContainerStarted","Data":"a70a4fca3a3410d8ae35b8855b1bf87890ea49eba0ff03a915a41a861824faea"} Jul 16 20:45:05.032930 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.032868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59568f5c74-dxl29" event={"ID":"72648fa1-677d-4d9f-9104-eec80532b941","Type":"ContainerStarted","Data":"8b2c3dc7b8e31ca5ceff0d48041a3e368219cb007f846d018a1482874a156f05"} Jul 16 20:45:05.033075 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.032941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59568f5c74-dxl29" event={"ID":"72648fa1-677d-4d9f-9104-eec80532b941","Type":"ContainerStarted","Data":"fe74ebaebce807a1924e5e24ee57e0ead84581f84ea37d95b0c979b5994dba11"} Jul 16 20:45:05.034414 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.034396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:05.066553 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.066445 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" podStartSLOduration=1.161673089 podStartE2EDuration="5.066428749s" totalImagesPullingTime="3.90475566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:45:05.064754331 +0000 UTC m=+728.323713783" watchObservedRunningTime="2026-07-16 20:45:05.066428749 +0000 UTC m=+728.325388230" Jul 16 20:45:05.094272 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.094200 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59568f5c74-dxl29" podStartSLOduration=1.613812689 podStartE2EDuration="2.094176425s" totalImagesPullingTime="480.363736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:45:05.091349396 +0000 UTC m=+728.350308845" watchObservedRunningTime="2026-07-16 20:45:05.094176425 +0000 UTC m=+728.353135875" Jul 16 20:45:05.143028 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.142997 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:45:05.143226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.143197 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" podUID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" containerName="authorino" containerID="cri-o://6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f" gracePeriod=30 Jul 16 20:45:05.392734 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.392708 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:45:05.544680 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.544643 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc9ls\" (UniqueName: \"kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls\") pod \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " Jul 16 20:45:05.544851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.544695 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert\") pod \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\" (UID: \"6bcc0cee-8f31-457c-81c8-eb5e855fb48c\") " Jul 16 20:45:05.546892 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.546866 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls" (OuterVolumeSpecName: "kube-api-access-nc9ls") pod "6bcc0cee-8f31-457c-81c8-eb5e855fb48c" (UID: "6bcc0cee-8f31-457c-81c8-eb5e855fb48c"). InnerVolumeSpecName "kube-api-access-nc9ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:45:05.556224 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.556197 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6bcc0cee-8f31-457c-81c8-eb5e855fb48c" (UID: "6bcc0cee-8f31-457c-81c8-eb5e855fb48c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:45:05.646477 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.646441 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc9ls\" (UniqueName: \"kubernetes.io/projected/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-kube-api-access-nc9ls\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:45:05.646624 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:05.646483 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6bcc0cee-8f31-457c-81c8-eb5e855fb48c-tls-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:45:06.044751 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.044660 2563 generic.go:356] "Generic (PLEG): container finished" podID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" containerID="6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f" exitCode=0 Jul 16 20:45:06.045226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.044757 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" event={"ID":"6bcc0cee-8f31-457c-81c8-eb5e855fb48c","Type":"ContainerDied","Data":"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f"} Jul 16 20:45:06.045226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.044790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" event={"ID":"6bcc0cee-8f31-457c-81c8-eb5e855fb48c","Type":"ContainerDied","Data":"08cb19986790d6bf3b1c526f3b03796c8da9a54ec27a21c02d7472e831b720c4"} Jul 16 20:45:06.045226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.044813 2563 scope.go:117] "RemoveContainer" containerID="6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f" Jul 16 20:45:06.045226 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.044973 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f4d4fbf9-h47fv" Jul 16 20:45:06.048922 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.048282 2563 generic.go:356] "Generic (PLEG): container finished" podID="ba19cc8b-1963-4856-bb52-b2efd497b1da" containerID="a70a4fca3a3410d8ae35b8855b1bf87890ea49eba0ff03a915a41a861824faea" exitCode=0 Jul 16 20:45:06.048922 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.048879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" event={"ID":"ba19cc8b-1963-4856-bb52-b2efd497b1da","Type":"ContainerDied","Data":"a70a4fca3a3410d8ae35b8855b1bf87890ea49eba0ff03a915a41a861824faea"} Jul 16 20:45:06.064141 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.064122 2563 scope.go:117] "RemoveContainer" containerID="6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f" Jul 16 20:45:06.064464 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:45:06.064441 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f\": container with ID starting with 6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f not found: ID does not exist" containerID="6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f" Jul 16 20:45:06.064530 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.064477 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f"} err="failed to get container status \"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f\": rpc error: code = NotFound desc = could not find container \"6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f\": container with ID starting with 6415a27ad516e5b2f0fe1bbc30bb4293ee2f240f1b81e1f1bbea5e1abf74986f not found: ID does not exist" Jul 16 20:45:06.113238 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.113206 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:45:06.120368 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:06.120339 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56f4d4fbf9-h47fv"] Jul 16 20:45:07.193641 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:07.193612 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" Jul 16 20:45:07.262330 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:07.262296 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" path="/var/lib/kubelet/pods/6bcc0cee-8f31-457c-81c8-eb5e855fb48c/volumes" Jul 16 20:45:08.061713 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:08.061687 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" Jul 16 20:45:08.061713 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:08.061691 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk" event={"ID":"ba19cc8b-1963-4856-bb52-b2efd497b1da","Type":"ContainerDied","Data":"11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368"} Jul 16 20:45:08.061895 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:08.061787 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11697cd5604c9f948b1df1a92a2f84b06357d8b74a851eb5069cdc19969c8368" Jul 16 20:45:20.900076 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:20.900040 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:45:50.624004 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.623971 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:45:50.624420 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.624176 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" podUID="1f993a0c-7698-424d-8e40-2453389d7c7e" containerName="manager" containerID="cri-o://1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02" gracePeriod=30 Jul 16 20:45:50.872630 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.872607 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:45:50.967015 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.966983 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ng6l\" (UniqueName: \"kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l\") pod \"1f993a0c-7698-424d-8e40-2453389d7c7e\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " Jul 16 20:45:50.967198 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.967064 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert\") pod \"1f993a0c-7698-424d-8e40-2453389d7c7e\" (UID: \"1f993a0c-7698-424d-8e40-2453389d7c7e\") " Jul 16 20:45:50.969194 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.969164 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1f993a0c-7698-424d-8e40-2453389d7c7e" (UID: "1f993a0c-7698-424d-8e40-2453389d7c7e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:45:50.969194 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:50.969181 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l" (OuterVolumeSpecName: "kube-api-access-5ng6l") pod "1f993a0c-7698-424d-8e40-2453389d7c7e" (UID: "1f993a0c-7698-424d-8e40-2453389d7c7e"). InnerVolumeSpecName "kube-api-access-5ng6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:45:51.067746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.067697 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ng6l\" (UniqueName: \"kubernetes.io/projected/1f993a0c-7698-424d-8e40-2453389d7c7e-kube-api-access-5ng6l\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:45:51.067746 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.067740 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f993a0c-7698-424d-8e40-2453389d7c7e-webhook-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:45:51.308778 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.308735 2563 generic.go:356] "Generic (PLEG): container finished" podID="1f993a0c-7698-424d-8e40-2453389d7c7e" containerID="1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02" exitCode=0 Jul 16 20:45:51.308979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.308793 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" Jul 16 20:45:51.308979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.308823 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" event={"ID":"1f993a0c-7698-424d-8e40-2453389d7c7e","Type":"ContainerDied","Data":"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02"} Jul 16 20:45:51.308979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.308925 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-lmvp2" event={"ID":"1f993a0c-7698-424d-8e40-2453389d7c7e","Type":"ContainerDied","Data":"ac7a56157d3ecbeff7934ba71bf3b2fd1a165e2b7a5d44e71051766694241a41"} Jul 16 20:45:51.308979 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.308957 2563 scope.go:117] "RemoveContainer" containerID="1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02" Jul 16 20:45:51.318126 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.318109 2563 scope.go:117] "RemoveContainer" containerID="1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02" Jul 16 20:45:51.318366 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:45:51.318350 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02\": container with ID starting with 1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02 not found: ID does not exist" containerID="1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02" Jul 16 20:45:51.318414 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.318374 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02"} err="failed to get container status \"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02\": rpc error: code = NotFound desc = could not find container \"1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02\": container with ID starting with 1e524a12e619194d8d8ec677f8a3f1883d76819f4af66a5e3ccc88266ff68f02 not found: ID does not exist" Jul 16 20:45:51.328169 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.328148 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:45:51.333457 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:51.333437 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-lmvp2"] Jul 16 20:45:53.260493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:45:53.260457 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f993a0c-7698-424d-8e40-2453389d7c7e" path="/var/lib/kubelet/pods/1f993a0c-7698-424d-8e40-2453389d7c7e/volumes" Jul 16 20:46:10.276950 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:10.276917 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:14.874912 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:14.874863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:14.931680 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:14.931657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:46:52.134288 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134253 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134627 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f993a0c-7698-424d-8e40-2453389d7c7e" containerName="manager" Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134637 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f993a0c-7698-424d-8e40-2453389d7c7e" containerName="manager" Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134647 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba19cc8b-1963-4856-bb52-b2efd497b1da" containerName="cleanup" Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134652 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba19cc8b-1963-4856-bb52-b2efd497b1da" containerName="cleanup" Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134670 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" containerName="authorino" Jul 16 20:46:52.134733 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134676 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" containerName="authorino" Jul 16 20:46:52.134947 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134742 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f993a0c-7698-424d-8e40-2453389d7c7e" containerName="manager" Jul 16 20:46:52.134947 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134751 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba19cc8b-1963-4856-bb52-b2efd497b1da" containerName="cleanup" Jul 16 20:46:52.134947 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.134758 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bcc0cee-8f31-457c-81c8-eb5e855fb48c" containerName="authorino" Jul 16 20:46:52.137775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.137758 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.141359 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.141337 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6jqml\"" Jul 16 20:46:52.141511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.141363 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:46:52.141511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.141338 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:46:52.146601 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.146575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:46:52.209006 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.208968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.209159 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.209041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhpp4\" (UniqueName: \"kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.310262 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.310228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.310442 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.310286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhpp4\" (UniqueName: \"kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.312877 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.312845 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.320244 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.320219 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhpp4\" (UniqueName: \"kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4\") pod \"maas-controller-54cbbd8d77-qxwlv\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.449271 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.449188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:52.581458 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.581427 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:46:52.582852 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:46:52.582824 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd367c58e_5901_4524_b642_da580eef5f1c.slice/crio-9d0d0b67128b36ddb87d25ce56bc20607d06098c29fa12504a716cf8ca7fabf3 WatchSource:0}: Error finding container 9d0d0b67128b36ddb87d25ce56bc20607d06098c29fa12504a716cf8ca7fabf3: Status 404 returned error can't find the container with id 9d0d0b67128b36ddb87d25ce56bc20607d06098c29fa12504a716cf8ca7fabf3 Jul 16 20:46:52.650897 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:52.650858 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" event={"ID":"d367c58e-5901-4524-b642-da580eef5f1c","Type":"ContainerStarted","Data":"9d0d0b67128b36ddb87d25ce56bc20607d06098c29fa12504a716cf8ca7fabf3"} Jul 16 20:46:53.657959 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:53.657924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" event={"ID":"d367c58e-5901-4524-b642-da580eef5f1c","Type":"ContainerStarted","Data":"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed"} Jul 16 20:46:53.658341 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:53.657993 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:46:53.676385 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:46:53.676332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" podStartSLOduration=1.286213281 podStartE2EDuration="1.676319236s" totalImagesPullingTime="390.105955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:46:53.673931181 +0000 UTC m=+836.932890632" watchObservedRunningTime="2026-07-16 20:46:53.676319236 +0000 UTC m=+836.935278684" Jul 16 20:47:00.707474 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:00.707420 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:00.809267 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:00.809232 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:04.665540 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:04.665506 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:47:09.259412 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.259362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:09.318522 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.318494 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:47:09.318731 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.318699 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" podUID="d367c58e-5901-4524-b642-da580eef5f1c" containerName="manager" containerID="cri-o://a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed" gracePeriod=30 Jul 16 20:47:09.566955 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.566929 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:47:09.684279 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.684245 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert\") pod \"d367c58e-5901-4524-b642-da580eef5f1c\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " Jul 16 20:47:09.684466 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.684307 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhpp4\" (UniqueName: \"kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4\") pod \"d367c58e-5901-4524-b642-da580eef5f1c\" (UID: \"d367c58e-5901-4524-b642-da580eef5f1c\") " Jul 16 20:47:09.686418 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.686393 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d367c58e-5901-4524-b642-da580eef5f1c" (UID: "d367c58e-5901-4524-b642-da580eef5f1c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 20:47:09.686493 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.686437 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4" (OuterVolumeSpecName: "kube-api-access-hhpp4") pod "d367c58e-5901-4524-b642-da580eef5f1c" (UID: "d367c58e-5901-4524-b642-da580eef5f1c"). InnerVolumeSpecName "kube-api-access-hhpp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 20:47:09.745587 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.745552 2563 generic.go:356] "Generic (PLEG): container finished" podID="d367c58e-5901-4524-b642-da580eef5f1c" containerID="a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed" exitCode=0 Jul 16 20:47:09.745765 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.745601 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" Jul 16 20:47:09.745765 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.745625 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" event={"ID":"d367c58e-5901-4524-b642-da580eef5f1c","Type":"ContainerDied","Data":"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed"} Jul 16 20:47:09.745765 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.745668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-qxwlv" event={"ID":"d367c58e-5901-4524-b642-da580eef5f1c","Type":"ContainerDied","Data":"9d0d0b67128b36ddb87d25ce56bc20607d06098c29fa12504a716cf8ca7fabf3"} Jul 16 20:47:09.745765 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.745689 2563 scope.go:117] "RemoveContainer" containerID="a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed" Jul 16 20:47:09.756126 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.756102 2563 scope.go:117] "RemoveContainer" containerID="a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed" Jul 16 20:47:09.756389 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:47:09.756368 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed\": container with ID starting with a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed not found: ID does not exist" containerID="a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed" Jul 16 20:47:09.756456 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.756397 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed"} err="failed to get container status \"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed\": rpc error: code = NotFound desc = could not find container \"a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed\": container with ID starting with a6997788c4b73ad0f48c47c066b5aea37f80b45225131e175a94849b09805aed not found: ID does not exist" Jul 16 20:47:09.768342 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.768316 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:47:09.774093 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.774068 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-qxwlv"] Jul 16 20:47:09.785929 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.785888 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d367c58e-5901-4524-b642-da580eef5f1c-webhook-cert\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:47:09.786001 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:09.785933 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhpp4\" (UniqueName: \"kubernetes.io/projected/d367c58e-5901-4524-b642-da580eef5f1c-kube-api-access-hhpp4\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:47:10.443018 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.442986 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:10.553006 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.552967 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-rsghj"] Jul 16 20:47:10.553451 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.553436 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d367c58e-5901-4524-b642-da580eef5f1c" containerName="manager" Jul 16 20:47:10.553524 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.553454 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d367c58e-5901-4524-b642-da580eef5f1c" containerName="manager" Jul 16 20:47:10.553524 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.553516 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d367c58e-5901-4524-b642-da580eef5f1c" containerName="manager" Jul 16 20:47:10.557737 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.557722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.561309 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.561283 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 16 20:47:10.561309 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.561298 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6jqml\"" Jul 16 20:47:10.561470 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.561298 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 16 20:47:10.567113 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.567092 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-rsghj"] Jul 16 20:47:10.695190 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.695088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06b107-35dd-4a73-809a-e14842d34485-webhook-cert\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.695356 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.695215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltpdz\" (UniqueName: \"kubernetes.io/projected/fe06b107-35dd-4a73-809a-e14842d34485-kube-api-access-ltpdz\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.796619 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.796588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06b107-35dd-4a73-809a-e14842d34485-webhook-cert\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.796788 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.796654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltpdz\" (UniqueName: \"kubernetes.io/projected/fe06b107-35dd-4a73-809a-e14842d34485-kube-api-access-ltpdz\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.799144 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.799115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe06b107-35dd-4a73-809a-e14842d34485-webhook-cert\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.805563 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.805536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltpdz\" (UniqueName: \"kubernetes.io/projected/fe06b107-35dd-4a73-809a-e14842d34485-kube-api-access-ltpdz\") pod \"maas-controller-54cbbd8d77-rsghj\" (UID: \"fe06b107-35dd-4a73-809a-e14842d34485\") " pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:10.868511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:10.868480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:11.003637 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.003613 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cbbd8d77-rsghj"] Jul 16 20:47:11.005818 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:47:11.005795 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe06b107_35dd_4a73_809a_e14842d34485.slice/crio-8dcf5b96f612f7d14c407f3b307d7e7d4611b4d84f450acbe6b7a85e0bb8d55c WatchSource:0}: Error finding container 8dcf5b96f612f7d14c407f3b307d7e7d4611b4d84f450acbe6b7a85e0bb8d55c: Status 404 returned error can't find the container with id 8dcf5b96f612f7d14c407f3b307d7e7d4611b4d84f450acbe6b7a85e0bb8d55c Jul 16 20:47:11.261377 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.261295 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d367c58e-5901-4524-b642-da580eef5f1c" path="/var/lib/kubelet/pods/d367c58e-5901-4524-b642-da580eef5f1c/volumes" Jul 16 20:47:11.760037 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.759999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" event={"ID":"fe06b107-35dd-4a73-809a-e14842d34485","Type":"ContainerStarted","Data":"e06479ca0ccb94d2542ba747e97fbe38b935f3dcc6b7e5f18f264d3f0e75f5d1"} Jul 16 20:47:11.760511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.760062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" event={"ID":"fe06b107-35dd-4a73-809a-e14842d34485","Type":"ContainerStarted","Data":"8dcf5b96f612f7d14c407f3b307d7e7d4611b4d84f450acbe6b7a85e0bb8d55c"} Jul 16 20:47:11.760511 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.760091 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:11.779321 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:11.779274 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" podStartSLOduration=1.386558561 podStartE2EDuration="1.779256939s" totalImagesPullingTime="392.698378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 20:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 20:47:11.77646348 +0000 UTC m=+855.035422931" watchObservedRunningTime="2026-07-16 20:47:11.779256939 +0000 UTC m=+855.038216407" Jul 16 20:47:17.034638 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:17.034602 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:17.134989 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:17.134963 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:22.767483 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:22.767451 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cbbd8d77-rsghj" Jul 16 20:47:49.128992 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:49.128891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:50.396924 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:50.396863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:51.017296 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:51.017265 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:51.177218 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:51.177185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:51.277379 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:51.277302 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:57.169191 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.169152 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:57.194947 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.194924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:47:57.196046 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.196025 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:47:57.233165 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.233137 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:57.329699 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.329672 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:57.424643 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.424549 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:47:57.526854 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:47:57.526826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:03.348651 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:48:03.348603 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:48:03.411098 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:48:03.411072 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:49:53.390270 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:49:53.390215 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:51:41.896810 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:51:41.896779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:52:57.241755 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:52:57.241724 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:52:57.244177 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:52:57.244156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:53:11.951703 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:53:11.951671 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:53:13.339686 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:53:13.339652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:56:49.964172 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:56:49.964083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:56:50.072996 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:56:50.072957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:57:57.279764 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:57:57.279738 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:57:57.284112 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:57:57.284092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 20:57:58.819831 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:57:58.819791 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:58:48.054061 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:58:48.054024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:58:53.457215 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:58:53.457167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:01.743660 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:01.743611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:06.926806 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:06.926766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:10.163284 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:10.163238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:10.261577 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:10.261545 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:10.642930 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:10.642871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:16.624513 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:16.624471 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:16.724331 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:16.724290 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:16.840711 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:16.840670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:16.941757 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:16.941725 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:17.952356 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:17.952306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.048666 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.048630 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.237991 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.237912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.410363 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.410325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.756549 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.756518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.856093 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.856061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:18.941002 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:18.940968 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:20.507034 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:20.507002 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 20:59:23.072820 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.072783 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:23.076474 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.076456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:23.078945 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.078918 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8hb99\"" Jul 16 20:59:23.079057 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.078925 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 20:59:23.084759 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.084698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:23.212299 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.212266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6\" (UID: \"a0cab58d-8797-40d0-9938-1d580fa6047a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:23.313525 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.313288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6\" (UID: \"a0cab58d-8797-40d0-9938-1d580fa6047a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:23.314082 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.314059 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6\" (UID: \"a0cab58d-8797-40d0-9938-1d580fa6047a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:23.387801 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.387764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:23.733269 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.733243 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:23.735359 ip-10-0-137-238 kubenswrapper[2563]: W0716 20:59:23.735333 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0cab58d_8797_40d0_9938_1d580fa6047a.slice/crio-0eba3f0afd9a9ccd66e7e072d5c7a3f7993d4abec4f889a05dc43d8d0d9e724c WatchSource:0}: Error finding container 0eba3f0afd9a9ccd66e7e072d5c7a3f7993d4abec4f889a05dc43d8d0d9e724c: Status 404 returned error can't find the container with id 0eba3f0afd9a9ccd66e7e072d5c7a3f7993d4abec4f889a05dc43d8d0d9e724c Jul 16 20:59:23.841775 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:23.841737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" event={"ID":"a0cab58d-8797-40d0-9938-1d580fa6047a","Type":"ContainerStarted","Data":"0eba3f0afd9a9ccd66e7e072d5c7a3f7993d4abec4f889a05dc43d8d0d9e724c"} Jul 16 20:59:24.848887 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:24.848850 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerID="5b01738bf615a4629fcf312b6c0f2239d7f733193e3fdc5601e4a19c30b07d8d" exitCode=7 Jul 16 20:59:24.849398 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:24.848934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" event={"ID":"a0cab58d-8797-40d0-9938-1d580fa6047a","Type":"ContainerDied","Data":"5b01738bf615a4629fcf312b6c0f2239d7f733193e3fdc5601e4a19c30b07d8d"} Jul 16 20:59:24.849398 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:24.849211 2563 scope.go:117] "RemoveContainer" containerID="5b01738bf615a4629fcf312b6c0f2239d7f733193e3fdc5601e4a19c30b07d8d" Jul 16 20:59:25.855779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:25.855689 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerID="258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829" exitCode=7 Jul 16 20:59:25.855779 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:25.855734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" event={"ID":"a0cab58d-8797-40d0-9938-1d580fa6047a","Type":"ContainerDied","Data":"258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829"} Jul 16 20:59:25.856277 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:25.855793 2563 scope.go:117] "RemoveContainer" containerID="5b01738bf615a4629fcf312b6c0f2239d7f733193e3fdc5601e4a19c30b07d8d" Jul 16 20:59:25.856277 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:25.855981 2563 scope.go:117] "RemoveContainer" containerID="258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829" Jul 16 20:59:25.856277 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:59:25.856216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6_odh-ai-gateway-infra(a0cab58d-8797-40d0-9938-1d580fa6047a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" Jul 16 20:59:26.862787 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:26.862760 2563 scope.go:117] "RemoveContainer" containerID="258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829" Jul 16 20:59:26.863182 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:59:26.862956 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6_odh-ai-gateway-infra(a0cab58d-8797-40d0-9938-1d580fa6047a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" Jul 16 20:59:41.254588 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:41.254559 2563 scope.go:117] "RemoveContainer" containerID="258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829" Jul 16 20:59:41.956700 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:41.956675 2563 generic.go:356] "Generic (PLEG): container finished" podID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerID="1275c8ab0f169a4717f970a9e5ecc3a72276de61f1cd4b13237c396599806411" exitCode=7 Jul 16 20:59:41.956814 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:41.956745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" event={"ID":"a0cab58d-8797-40d0-9938-1d580fa6047a","Type":"ContainerDied","Data":"1275c8ab0f169a4717f970a9e5ecc3a72276de61f1cd4b13237c396599806411"} Jul 16 20:59:41.956814 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:41.956800 2563 scope.go:117] "RemoveContainer" containerID="258c1d13d9b9bdd7e8f63caad4727b8f2edf941cb1949d3a243336d5dfdc7829" Jul 16 20:59:41.957132 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:41.957111 2563 scope.go:117] "RemoveContainer" containerID="1275c8ab0f169a4717f970a9e5ecc3a72276de61f1cd4b13237c396599806411" Jul 16 20:59:41.957326 ip-10-0-137-238 kubenswrapper[2563]: E0716 20:59:41.957305 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6_odh-ai-gateway-infra(a0cab58d-8797-40d0-9938-1d580fa6047a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" Jul 16 20:59:42.982174 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:42.982136 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:43.118566 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.118539 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:43.190683 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.190658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca\") pod \"a0cab58d-8797-40d0-9938-1d580fa6047a\" (UID: \"a0cab58d-8797-40d0-9938-1d580fa6047a\") " Jul 16 20:59:43.191009 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.190989 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a0cab58d-8797-40d0-9938-1d580fa6047a" (UID: "a0cab58d-8797-40d0-9938-1d580fa6047a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 20:59:43.291203 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.291174 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cab58d-8797-40d0-9938-1d580fa6047a-maas-api-service-ca\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 20:59:43.971041 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.971016 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" Jul 16 20:59:43.971206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.971059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6" event={"ID":"a0cab58d-8797-40d0-9938-1d580fa6047a","Type":"ContainerDied","Data":"0eba3f0afd9a9ccd66e7e072d5c7a3f7993d4abec4f889a05dc43d8d0d9e724c"} Jul 16 20:59:43.971206 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.971117 2563 scope.go:117] "RemoveContainer" containerID="1275c8ab0f169a4717f970a9e5ecc3a72276de61f1cd4b13237c396599806411" Jul 16 20:59:43.987851 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.987829 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:43.996409 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:43.996390 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23a5a19c-wd9b6"] Jul 16 20:59:45.260553 ip-10-0-137-238 kubenswrapper[2563]: I0716 20:59:45.260513 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" path="/var/lib/kubelet/pods/a0cab58d-8797-40d0-9938-1d580fa6047a/volumes" Jul 16 21:02:23.254259 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:23.254212 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:23.319678 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:23.319648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:28.965070 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:28.965036 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:29.342052 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:29.341977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:32.505011 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:32.504973 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:32.606152 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:32.606122 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:35.076402 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:35.076372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:35.159291 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:35.159254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:35.359070 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:35.358974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:35.452607 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:35.452572 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:35.561434 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:35.561388 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:36.889874 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:36.889823 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:37.000088 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:37.000056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:37.215562 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:37.215484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:37.487960 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:37.487852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:37.591414 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:37.591383 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:39.571556 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:39.571516 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:39.673970 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:39.673934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:43.550668 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:43.550618 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:50.084579 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:50.084531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:02:57.318232 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:57.318208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:02:57.324013 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:02:57.323979 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:03:41.505069 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:41.505028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:41.603504 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:41.603454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:47.910320 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:47.910273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:48.028371 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:48.028325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:48.168015 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:48.167930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:54.138632 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:54.138598 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:55.832986 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:55.832934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:56.010480 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:56.010444 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:57.076431 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:57.076403 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:57.201511 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:57.201481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:03:58.051627 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:03:58.051578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:04:22.462194 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:04:22.462114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:05:35.970100 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:05:35.970062 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:07:33.324501 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:33.324466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:07:33.408010 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:33.407971 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:07:44.653093 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:44.653053 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:07:44.754212 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:44.754179 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:07:57.354973 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:57.354940 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:07:57.362566 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:07:57.362539 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:10:00.972768 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:00.972736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:04.306992 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:04.306958 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:06.445149 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:06.445115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:07.233443 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:07.233407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:13.120606 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:13.120573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:13.198719 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:13.198675 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:13.410031 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:13.409994 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:14.526398 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:14.526360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:14.646841 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:14.646809 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:14.724870 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:14.724823 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:15.136243 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:15.136203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:15.506986 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:15.506866 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:15.595083 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:15.595048 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:17.662058 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:17.662020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:17.760715 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:17.760679 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:10:21.359070 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:10:21.359032 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:11:24.494823 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:11:24.494785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:11:25.548673 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:11:25.548638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:11:25.614715 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:11:25.614670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:11:36.402533 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:11:36.402461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:34.046400 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:34.046324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:34.145285 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:34.145250 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:39.145851 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:39.145810 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:39.245520 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:39.245490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:45.019959 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:45.019888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:12:57.391344 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:57.391302 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:12:57.402202 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:12:57.402177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:13:19.076483 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:19.076393 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:19.181729 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:19.181694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:24.982640 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:24.982556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:25.543893 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:25.543838 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:31.120429 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:31.120393 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:31.192790 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:31.192762 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:31.701629 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:31.701593 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:31.903071 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:31.903017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:33.382581 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:33.382550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:35.920455 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:35.920398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:39.267659 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:39.267623 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:39.376779 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:39.376747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:39.471158 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:39.471127 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:39.567766 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:39.567659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:13:40.135201 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:13:40.135166 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:06.003082 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:06.003045 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:12.030786 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:12.030719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:12.160038 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:12.159995 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:12.386689 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:12.386638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:12.483066 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:12.483035 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:28.241326 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:28.241290 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:34.081006 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:34.080974 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:34.193565 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:34.193531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:34.283688 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:34.283657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:44.855815 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:44.855780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:45.666011 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:45.665978 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:51.689246 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:51.689169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:51.747546 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:51.747512 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:51.842496 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:51.842466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:51.941839 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:51.941761 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:52.011556 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:52.011522 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:52.817957 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:52.817923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:52.917115 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:52.917074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:53.057490 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:53.057449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:14:54.690267 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:14:54.690236 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:00.736761 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:00.736727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:00.812626 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:00.812594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:01.487156 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:01.487122 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:07.438641 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:07.438601 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:08.889178 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:08.889139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:11.350021 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:11.349990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:11.493568 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:11.493530 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:11.644141 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:11.644106 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:12.430532 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:12.430489 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:12.536026 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:12.535990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:15.818243 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:15.818207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:16.519480 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:16.519446 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:16.614921 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:16.614884 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:16.969680 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:16.969642 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:22.850834 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:22.850796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:22.953760 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:22.953725 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:33.871683 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:33.871647 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:38.311056 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:38.311001 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:44.121756 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:44.121711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:44.197379 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:44.197338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:49.027125 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:49.027093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:49.278692 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:49.278605 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:49.727256 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:49.727217 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:49.793002 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:49.792966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:55.747737 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:55.747697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:55.825898 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:55.825824 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:55.921063 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:55.921012 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:56.022278 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:56.022172 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:15:56.130885 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:15:56.130835 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:02.183144 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:02.183083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:02.283641 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:02.283611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:09.178576 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:09.178526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:09.583410 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:09.583311 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:09.810060 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:09.810007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:12.640614 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:12.640579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:12.741205 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:12.741170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:12.839776 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:12.839750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:13.294341 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:13.294297 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:13.393444 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:13.393373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:17.155473 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:17.155413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:24.512679 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:24.512570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:51.143655 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:51.143616 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:16:51.244588 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:16:51.244560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:06.095399 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:06.095364 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:10.672133 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:10.672083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:15.723967 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:15.723928 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:35.083928 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:35.083871 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:35.253078 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:35.253044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:52.077257 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:52.077177 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:53.094472 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:53.094436 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:17:57.429622 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:57.429595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:17:57.440838 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:57.440816 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:17:58.650480 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:17:58.650436 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:13.878219 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:13.878180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:13.980393 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:13.980357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:23.114809 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:23.114777 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:23.353347 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:23.353312 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:24.455297 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:24.455261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:24.552222 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:24.552190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:24.651323 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:24.651288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:25.411672 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:25.411621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:25.511582 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:25.511539 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:25.615380 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:25.615351 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:27.077940 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:27.077837 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:33.228554 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:33.228517 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:33.456362 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:33.456322 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:33.933247 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:33.933211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:40.165728 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:40.165693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:40.323923 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:40.323868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:46.619492 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:46.619451 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:46.720923 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:46.720879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:50.832066 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:50.832027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:18:51.255750 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:18:51.255712 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:12.193098 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:12.193037 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:18.260226 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:18.260144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:18.362654 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:18.362621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:18.634866 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:18.634827 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:18.969859 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:18.969779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:19.197952 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:19.197894 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:21.628118 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:21.628087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:21.729220 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:21.729172 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:21.839680 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:21.839644 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:22.396665 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:22.396632 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:22.461658 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:22.461627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:22.560988 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:22.560960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:26.191305 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:26.191270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:26.539925 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:26.539820 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:26.865722 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:26.865686 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:27.059806 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:27.059719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:29.713881 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:29.713842 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:29.801920 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:29.801875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:29.903242 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:29.903206 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:30.002393 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:30.002304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:30.629641 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:30.629605 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:30.730786 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:30.730753 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:34.203123 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:34.203090 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:41.569323 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:41.569290 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:43.329238 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:43.329199 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:43.428227 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:43.428194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:51.418765 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:51.418727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:19:51.520019 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:19:51.519984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:08.122002 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:08.121965 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:27.974682 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:27.974649 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:29.551646 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:29.551607 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:39.248056 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:39.248021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:43.879072 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:43.879038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:49.737299 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:49.737211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:49.837600 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:49.837565 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:54.579815 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:54.579785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:54.898096 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:54.898066 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:55.680093 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:55.680056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:20:55.829588 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:20:55.829542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:05.423462 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:05.423408 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:10.036603 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:10.036572 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:16.245279 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:16.245244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:16.342323 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:16.342295 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:20.738040 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:20.738002 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:20.960760 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:20.960726 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:21.299422 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:21.299389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:21.622251 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:21.622171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:22.087875 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:22.087843 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:24.327202 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:24.327158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:24.402808 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:24.402769 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:24.548181 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:24.548150 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:24.657060 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:24.657020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:25.009435 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:25.009358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:25.109429 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:25.109396 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:28.838431 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:28.838383 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:29.274505 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:29.274475 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:29.601965 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:29.601840 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:29.743600 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:29.743558 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:32.328415 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:32.328371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:32.445061 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:32.445031 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:32.545783 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:32.545750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:33.013844 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:33.013786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:33.111456 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:33.111423 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:33.236252 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:33.236223 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:36.814958 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:36.814925 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:45.359454 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:45.359403 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:45.457022 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:45.456982 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:53.863303 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:53.863262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:53.965203 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:53.965163 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:54.045789 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:54.045752 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:55.535722 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:55.535691 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:55.634927 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:55.634863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:55.811284 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:55.811213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:21:59.937015 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:21:59.936964 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:05.443458 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:05.443417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:05.950054 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:05.950026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:06.051428 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:06.051389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:10.627322 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:10.627270 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:10.853338 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:10.853306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:11.510861 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:11.510826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:11.611179 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:11.611137 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:21.439755 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:21.439674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:26.062652 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:26.062615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:31.842599 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:31.842542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:31.943656 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:31.943626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:33.242233 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:33.242198 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:35.988670 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:35.988637 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:36.088754 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:36.088729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:36.766834 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:36.766805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:36.991810 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:36.991780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:37.321890 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:37.321853 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:37.670631 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:37.670594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:38.172576 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:38.172548 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:40.733689 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:40.733655 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:40.835604 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:40.835576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:40.925117 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:40.925087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:41.024699 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:41.024608 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:41.581452 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:41.581416 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:41.679190 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:41.679156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:45.276291 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:45.276258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:45.614393 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:45.614306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:46.031522 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:46.031488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:46.179769 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:46.179738 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:46.394977 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:46.394944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:48.776533 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:48.776494 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:48.873115 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:48.873085 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:48.954654 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:48.954621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:49.076675 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:49.076595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:49.493780 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:49.493746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:49.572352 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:49.572308 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:53.276609 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:53.276569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:22:57.465713 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:57.465688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:22:57.477149 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:57.477129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:22:57.771065 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:22:57.770987 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:02.657727 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:02.657692 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:02.757740 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:02.757715 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:04.235043 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:04.235003 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:10.339334 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:10.339289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:10.438545 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:10.438509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:29.508714 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:29.508676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:23:58.043590 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:23:58.043508 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:25:25.423358 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:25:25.423284 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:25:26.224538 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:25:26.224510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:25:33.014884 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:25:33.014848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:26:12.318681 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:26:12.318641 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:03.125809 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:03.125724 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:03.921525 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:03.921488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:08.608237 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:08.608195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:16.153759 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:16.153719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:16.254572 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:16.254534 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:18.726545 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:18.726499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:36.757525 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:36.757485 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:36.864545 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:36.864509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:57.217189 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:57.217155 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:27:57.507533 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:57.507405 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:27:57.522778 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:27:57.522752 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5bvf_1c4b467b-ce68-46f2-ace2-fb5b9c56a32f/ovn-acl-logging/0.log" Jul 16 21:28:03.431293 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:03.431259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:03.527001 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:03.526962 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:11.127388 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:11.127352 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:11.323961 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:11.323894 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:42.601684 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:42.601650 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:43.485004 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:43.484961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:28:44.472710 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.472673 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905796144"] Jul 16 21:28:44.473169 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473074 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.473169 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473086 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.473169 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473105 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.473169 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473110 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.473327 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473179 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.473327 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.473187 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:44.476273 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.476258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:44.479572 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.479545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ktvhx\"" Jul 16 21:28:44.482336 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.482309 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905796144"] Jul 16 21:28:44.558347 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.558312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67lh6\" (UniqueName: \"kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6\") pod \"test-curl-7428-140194905796144\" (UID: \"3063523e-bebe-474a-8514-7fdb68720f9f\") " pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:44.658775 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.658739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67lh6\" (UniqueName: \"kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6\") pod \"test-curl-7428-140194905796144\" (UID: \"3063523e-bebe-474a-8514-7fdb68720f9f\") " pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:44.668083 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.668048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67lh6\" (UniqueName: \"kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6\") pod \"test-curl-7428-140194905796144\" (UID: \"3063523e-bebe-474a-8514-7fdb68720f9f\") " pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:44.787331 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.787244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:44.922889 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.922862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905796144"] Jul 16 21:28:44.924723 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:28:44.924695 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3063523e_bebe_474a_8514_7fdb68720f9f.slice/crio-bdd03e547569f45ac283c8f3a0c2b41f71c110e3802e7cd0340c772136d94fe7 WatchSource:0}: Error finding container bdd03e547569f45ac283c8f3a0c2b41f71c110e3802e7cd0340c772136d94fe7: Status 404 returned error can't find the container with id bdd03e547569f45ac283c8f3a0c2b41f71c110e3802e7cd0340c772136d94fe7 Jul 16 21:28:44.926430 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:44.926414 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:28:45.537351 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:45.537310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905796144" event={"ID":"3063523e-bebe-474a-8514-7fdb68720f9f","Type":"ContainerStarted","Data":"bdd03e547569f45ac283c8f3a0c2b41f71c110e3802e7cd0340c772136d94fe7"} Jul 16 21:28:46.544534 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:46.544491 2563 generic.go:356] "Generic (PLEG): container finished" podID="3063523e-bebe-474a-8514-7fdb68720f9f" containerID="feac0dd5edcf4a8927624d9d0950bd462a5198b949ee66855c501aea99156909" exitCode=0 Jul 16 21:28:46.545011 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:46.544581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905796144" event={"ID":"3063523e-bebe-474a-8514-7fdb68720f9f","Type":"ContainerDied","Data":"feac0dd5edcf4a8927624d9d0950bd462a5198b949ee66855c501aea99156909"} Jul 16 21:28:47.689850 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.689821 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:47.711860 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.711829 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905796144_3063523e-bebe-474a-8514-7fdb68720f9f/test-curl-7428-140194905796144/0.log" Jul 16 21:28:47.738585 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.738556 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905796144"] Jul 16 21:28:47.740754 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.740732 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905796144"] Jul 16 21:28:47.789486 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.789445 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67lh6\" (UniqueName: \"kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6\") pod \"3063523e-bebe-474a-8514-7fdb68720f9f\" (UID: \"3063523e-bebe-474a-8514-7fdb68720f9f\") " Jul 16 21:28:47.791718 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.791694 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6" (OuterVolumeSpecName: "kube-api-access-67lh6") pod "3063523e-bebe-474a-8514-7fdb68720f9f" (UID: "3063523e-bebe-474a-8514-7fdb68720f9f"). InnerVolumeSpecName "kube-api-access-67lh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:28:47.870748 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.870666 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905752112"] Jul 16 21:28:47.871105 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871090 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3063523e-bebe-474a-8514-7fdb68720f9f" containerName="test-curl-7428-140194905796144" Jul 16 21:28:47.871154 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871109 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3063523e-bebe-474a-8514-7fdb68720f9f" containerName="test-curl-7428-140194905796144" Jul 16 21:28:47.871154 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871122 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:47.871154 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871127 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:47.871255 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871198 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0cab58d-8797-40d0-9938-1d580fa6047a" containerName="revoke-keys" Jul 16 21:28:47.871255 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.871210 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3063523e-bebe-474a-8514-7fdb68720f9f" containerName="test-curl-7428-140194905796144" Jul 16 21:28:47.874173 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.874159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:47.878544 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.878517 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905752112"] Jul 16 21:28:47.890551 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.890527 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67lh6\" (UniqueName: \"kubernetes.io/projected/3063523e-bebe-474a-8514-7fdb68720f9f-kube-api-access-67lh6\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:28:47.991847 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:47.991814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrn8n\" (UniqueName: \"kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n\") pod \"test-curl-7428-140194905752112\" (UID: \"c5993c27-f43c-494f-a1bb-41f0fc5272e8\") " pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:48.093323 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.093282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrn8n\" (UniqueName: \"kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n\") pod \"test-curl-7428-140194905752112\" (UID: \"c5993c27-f43c-494f-a1bb-41f0fc5272e8\") " pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:48.102990 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.102964 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrn8n\" (UniqueName: \"kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n\") pod \"test-curl-7428-140194905752112\" (UID: \"c5993c27-f43c-494f-a1bb-41f0fc5272e8\") " pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:48.183987 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.183958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:48.324659 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.324634 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905752112"] Jul 16 21:28:48.325369 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:28:48.325341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5993c27_f43c_494f_a1bb_41f0fc5272e8.slice/crio-679979cd01c0351f22418ff06c1e795e0027c5b4393c61065e13877280b213f0 WatchSource:0}: Error finding container 679979cd01c0351f22418ff06c1e795e0027c5b4393c61065e13877280b213f0: Status 404 returned error can't find the container with id 679979cd01c0351f22418ff06c1e795e0027c5b4393c61065e13877280b213f0 Jul 16 21:28:48.556141 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.556051 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:48.556141 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.556076 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdd03e547569f45ac283c8f3a0c2b41f71c110e3802e7cd0340c772136d94fe7" Jul 16 21:28:48.557224 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:48.557200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905752112" event={"ID":"c5993c27-f43c-494f-a1bb-41f0fc5272e8","Type":"ContainerStarted","Data":"679979cd01c0351f22418ff06c1e795e0027c5b4393c61065e13877280b213f0"} Jul 16 21:28:48.566995 ip-10-0-137-238 kubenswrapper[2563]: E0716 21:28:48.566968 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7428-140194905796144\" is forbidden: User \"system:node:ip-10-0-137-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-238.ec2.internal' and this object" podUID="3063523e-bebe-474a-8514-7fdb68720f9f" pod="opendatahub/test-curl-7428-140194905796144" Jul 16 21:28:49.260852 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:49.260818 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3063523e-bebe-474a-8514-7fdb68720f9f" path="/var/lib/kubelet/pods/3063523e-bebe-474a-8514-7fdb68720f9f/volumes" Jul 16 21:28:49.563881 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:49.563792 2563 generic.go:356] "Generic (PLEG): container finished" podID="c5993c27-f43c-494f-a1bb-41f0fc5272e8" containerID="68ae24fd8d97ac4e677515c0fd4614385b57ff09c0428af70bbe9586d5a85802" exitCode=0 Jul 16 21:28:49.564058 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:49.563881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905752112" event={"ID":"c5993c27-f43c-494f-a1bb-41f0fc5272e8","Type":"ContainerDied","Data":"68ae24fd8d97ac4e677515c0fd4614385b57ff09c0428af70bbe9586d5a85802"} Jul 16 21:28:50.714525 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.714502 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:50.735968 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.735939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905752112_c5993c27-f43c-494f-a1bb-41f0fc5272e8/test-curl-7428-140194905752112/0.log" Jul 16 21:28:50.763394 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.763358 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905752112"] Jul 16 21:28:50.767270 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.767247 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905752112"] Jul 16 21:28:50.821832 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.821806 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrn8n\" (UniqueName: \"kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n\") pod \"c5993c27-f43c-494f-a1bb-41f0fc5272e8\" (UID: \"c5993c27-f43c-494f-a1bb-41f0fc5272e8\") " Jul 16 21:28:50.824118 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.824089 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n" (OuterVolumeSpecName: "kube-api-access-vrn8n") pod "c5993c27-f43c-494f-a1bb-41f0fc5272e8" (UID: "c5993c27-f43c-494f-a1bb-41f0fc5272e8"). InnerVolumeSpecName "kube-api-access-vrn8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:28:50.923131 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.923087 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrn8n\" (UniqueName: \"kubernetes.io/projected/c5993c27-f43c-494f-a1bb-41f0fc5272e8-kube-api-access-vrn8n\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:28:50.933679 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.933645 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:50.934119 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.934105 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5993c27-f43c-494f-a1bb-41f0fc5272e8" containerName="test-curl-7428-140194905752112" Jul 16 21:28:50.934169 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.934121 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5993c27-f43c-494f-a1bb-41f0fc5272e8" containerName="test-curl-7428-140194905752112" Jul 16 21:28:50.934204 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.934180 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5993c27-f43c-494f-a1bb-41f0fc5272e8" containerName="test-curl-7428-140194905752112" Jul 16 21:28:50.937200 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.937185 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:50.945289 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:50.945267 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:51.024571 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.024527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zvr\" (UniqueName: \"kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr\") pod \"test-curl-7428-140194905744704\" (UID: \"8475ea3b-44b5-42ed-afb2-d950c5c0ca95\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:51.125764 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.125661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zvr\" (UniqueName: \"kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr\") pod \"test-curl-7428-140194905744704\" (UID: \"8475ea3b-44b5-42ed-afb2-d950c5c0ca95\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:51.135203 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.135173 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zvr\" (UniqueName: \"kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr\") pod \"test-curl-7428-140194905744704\" (UID: \"8475ea3b-44b5-42ed-afb2-d950c5c0ca95\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:51.248067 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.248021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:51.260606 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.260580 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5993c27-f43c-494f-a1bb-41f0fc5272e8" path="/var/lib/kubelet/pods/c5993c27-f43c-494f-a1bb-41f0fc5272e8/volumes" Jul 16 21:28:51.399982 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.399955 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:51.402050 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:28:51.402026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8475ea3b_44b5_42ed_afb2_d950c5c0ca95.slice/crio-f4f11c9d2307d9fc6bdc83d0492228776c77dff8bb8ccd05a5d79f33fe14446f WatchSource:0}: Error finding container f4f11c9d2307d9fc6bdc83d0492228776c77dff8bb8ccd05a5d79f33fe14446f: Status 404 returned error can't find the container with id f4f11c9d2307d9fc6bdc83d0492228776c77dff8bb8ccd05a5d79f33fe14446f Jul 16 21:28:51.577516 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.577478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905744704" event={"ID":"8475ea3b-44b5-42ed-afb2-d950c5c0ca95","Type":"ContainerStarted","Data":"f4f11c9d2307d9fc6bdc83d0492228776c77dff8bb8ccd05a5d79f33fe14446f"} Jul 16 21:28:51.578864 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.578846 2563 scope.go:117] "RemoveContainer" containerID="68ae24fd8d97ac4e677515c0fd4614385b57ff09c0428af70bbe9586d5a85802" Jul 16 21:28:51.578864 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:51.578863 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905752112" Jul 16 21:28:52.585738 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:52.585704 2563 generic.go:356] "Generic (PLEG): container finished" podID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" containerID="74ddfe8993c7e6099f9984db5a390bddb1a419549f6af8c31fcc8c3355d0d9d0" exitCode=0 Jul 16 21:28:52.586168 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:52.585787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905744704" event={"ID":"8475ea3b-44b5-42ed-afb2-d950c5c0ca95","Type":"ContainerDied","Data":"74ddfe8993c7e6099f9984db5a390bddb1a419549f6af8c31fcc8c3355d0d9d0"} Jul 16 21:28:53.730311 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.730289 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:53.751126 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.751100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905744704_8475ea3b-44b5-42ed-afb2-d950c5c0ca95/test-curl-7428-140194905744704/0.log" Jul 16 21:28:53.777101 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.777068 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:53.781271 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.781244 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:53.850326 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.850236 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8zvr\" (UniqueName: \"kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr\") pod \"8475ea3b-44b5-42ed-afb2-d950c5c0ca95\" (UID: \"8475ea3b-44b5-42ed-afb2-d950c5c0ca95\") " Jul 16 21:28:53.852508 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.852483 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr" (OuterVolumeSpecName: "kube-api-access-h8zvr") pod "8475ea3b-44b5-42ed-afb2-d950c5c0ca95" (UID: "8475ea3b-44b5-42ed-afb2-d950c5c0ca95"). InnerVolumeSpecName "kube-api-access-h8zvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:28:53.907222 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.907187 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:53.907599 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.907586 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" containerName="test-curl-7428-140194905744704" Jul 16 21:28:53.907644 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.907600 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" containerName="test-curl-7428-140194905744704" Jul 16 21:28:53.907680 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.907676 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" containerName="test-curl-7428-140194905744704" Jul 16 21:28:53.910645 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.910630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:53.917323 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.917293 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:53.951209 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:53.951169 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8zvr\" (UniqueName: \"kubernetes.io/projected/8475ea3b-44b5-42ed-afb2-d950c5c0ca95-kube-api-access-h8zvr\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:28:54.052642 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.052604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4c7\" (UniqueName: \"kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7\") pod \"test-curl-7428-140194905744704\" (UID: \"5c64b282-13ce-4c42-8001-be7f02fbcbde\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:54.153714 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.153686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4c7\" (UniqueName: \"kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7\") pod \"test-curl-7428-140194905744704\" (UID: \"5c64b282-13ce-4c42-8001-be7f02fbcbde\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:54.162053 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.162028 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4c7\" (UniqueName: \"kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7\") pod \"test-curl-7428-140194905744704\" (UID: \"5c64b282-13ce-4c42-8001-be7f02fbcbde\") " pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:54.220989 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.220954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:54.356271 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.356245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:54.358005 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:28:54.357982 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c64b282_13ce_4c42_8001_be7f02fbcbde.slice/crio-046b30abe19e4f6d701dc9e57e75b3f508c9506abc2183c31f5587871cc203dc WatchSource:0}: Error finding container 046b30abe19e4f6d701dc9e57e75b3f508c9506abc2183c31f5587871cc203dc: Status 404 returned error can't find the container with id 046b30abe19e4f6d701dc9e57e75b3f508c9506abc2183c31f5587871cc203dc Jul 16 21:28:54.599151 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.599068 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4f11c9d2307d9fc6bdc83d0492228776c77dff8bb8ccd05a5d79f33fe14446f" Jul 16 21:28:54.599151 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.599069 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:54.600275 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.600243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905744704" event={"ID":"5c64b282-13ce-4c42-8001-be7f02fbcbde","Type":"ContainerStarted","Data":"046b30abe19e4f6d701dc9e57e75b3f508c9506abc2183c31f5587871cc203dc"} Jul 16 21:28:54.611097 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:54.611068 2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7428-140194905744704" oldPodUID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" podUID="5c64b282-13ce-4c42-8001-be7f02fbcbde" Jul 16 21:28:55.260092 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:55.260058 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8475ea3b-44b5-42ed-afb2-d950c5c0ca95" path="/var/lib/kubelet/pods/8475ea3b-44b5-42ed-afb2-d950c5c0ca95/volumes" Jul 16 21:28:55.608079 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:55.607993 2563 generic.go:356] "Generic (PLEG): container finished" podID="5c64b282-13ce-4c42-8001-be7f02fbcbde" containerID="b2e2423e51807970a07f2169cdca8d1269d9d28180bde663532db3f38d1dffea" exitCode=0 Jul 16 21:28:55.608079 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:55.608067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905744704" event={"ID":"5c64b282-13ce-4c42-8001-be7f02fbcbde","Type":"ContainerDied","Data":"b2e2423e51807970a07f2169cdca8d1269d9d28180bde663532db3f38d1dffea"} Jul 16 21:28:56.755671 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.755643 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:56.795636 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.795607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905744704_5c64b282-13ce-4c42-8001-be7f02fbcbde/test-curl-7428-140194905744704/0.log" Jul 16 21:28:56.832812 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.832772 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:56.840246 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.840219 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905744704"] Jul 16 21:28:56.877851 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.877780 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw4c7\" (UniqueName: \"kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7\") pod \"5c64b282-13ce-4c42-8001-be7f02fbcbde\" (UID: \"5c64b282-13ce-4c42-8001-be7f02fbcbde\") " Jul 16 21:28:56.880109 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.880072 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7" (OuterVolumeSpecName: "kube-api-access-gw4c7") pod "5c64b282-13ce-4c42-8001-be7f02fbcbde" (UID: "5c64b282-13ce-4c42-8001-be7f02fbcbde"). InnerVolumeSpecName "kube-api-access-gw4c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:28:56.971284 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.971246 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:56.971637 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.971625 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c64b282-13ce-4c42-8001-be7f02fbcbde" containerName="test-curl-7428-140194905744704" Jul 16 21:28:56.971687 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.971639 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c64b282-13ce-4c42-8001-be7f02fbcbde" containerName="test-curl-7428-140194905744704" Jul 16 21:28:56.971719 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.971707 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c64b282-13ce-4c42-8001-be7f02fbcbde" containerName="test-curl-7428-140194905744704" Jul 16 21:28:56.974701 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.974685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:56.978741 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.978708 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw4c7\" (UniqueName: \"kubernetes.io/projected/5c64b282-13ce-4c42-8001-be7f02fbcbde-kube-api-access-gw4c7\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:28:56.979581 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:56.979559 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:57.080130 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.080096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2gx6\" (UniqueName: \"kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6\") pod \"test-curl-7428-140194905745712\" (UID: \"108cedee-1642-499a-986c-d17e428a070a\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:57.181037 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.180987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2gx6\" (UniqueName: \"kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6\") pod \"test-curl-7428-140194905745712\" (UID: \"108cedee-1642-499a-986c-d17e428a070a\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:57.189870 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.189840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2gx6\" (UniqueName: \"kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6\") pod \"test-curl-7428-140194905745712\" (UID: \"108cedee-1642-499a-986c-d17e428a070a\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:57.260037 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.259994 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c64b282-13ce-4c42-8001-be7f02fbcbde" path="/var/lib/kubelet/pods/5c64b282-13ce-4c42-8001-be7f02fbcbde/volumes" Jul 16 21:28:57.285659 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.285628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:57.425857 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:28:57.425811 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod108cedee_1642_499a_986c_d17e428a070a.slice/crio-15a4d7257fbcec68207d710a7acb1acb2d8b1ab5db3be1c9c84af94a16706c5f WatchSource:0}: Error finding container 15a4d7257fbcec68207d710a7acb1acb2d8b1ab5db3be1c9c84af94a16706c5f: Status 404 returned error can't find the container with id 15a4d7257fbcec68207d710a7acb1acb2d8b1ab5db3be1c9c84af94a16706c5f Jul 16 21:28:57.426498 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.426465 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:57.619817 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.619785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905745712" event={"ID":"108cedee-1642-499a-986c-d17e428a070a","Type":"ContainerStarted","Data":"15a4d7257fbcec68207d710a7acb1acb2d8b1ab5db3be1c9c84af94a16706c5f"} Jul 16 21:28:57.621037 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.621012 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905744704" Jul 16 21:28:57.621105 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:57.621045 2563 scope.go:117] "RemoveContainer" containerID="b2e2423e51807970a07f2169cdca8d1269d9d28180bde663532db3f38d1dffea" Jul 16 21:28:58.627937 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:58.627881 2563 generic.go:356] "Generic (PLEG): container finished" podID="108cedee-1642-499a-986c-d17e428a070a" containerID="c757463a15aad2cfc520f5287ce144d8123734417eb3cf0f67f6cfbdf8324f55" exitCode=0 Jul 16 21:28:58.628358 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:58.627965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905745712" event={"ID":"108cedee-1642-499a-986c-d17e428a070a","Type":"ContainerDied","Data":"c757463a15aad2cfc520f5287ce144d8123734417eb3cf0f67f6cfbdf8324f55"} Jul 16 21:28:59.772630 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.772605 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:59.793227 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.793199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905745712_108cedee-1642-499a-986c-d17e428a070a/test-curl-7428-140194905745712/0.log" Jul 16 21:28:59.822104 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.822069 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:59.825358 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.825335 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:59.909728 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.909642 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2gx6\" (UniqueName: \"kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6\") pod \"108cedee-1642-499a-986c-d17e428a070a\" (UID: \"108cedee-1642-499a-986c-d17e428a070a\") " Jul 16 21:28:59.911839 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.911812 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6" (OuterVolumeSpecName: "kube-api-access-p2gx6") pod "108cedee-1642-499a-986c-d17e428a070a" (UID: "108cedee-1642-499a-986c-d17e428a070a"). InnerVolumeSpecName "kube-api-access-p2gx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:28:59.947186 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.947147 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:28:59.947598 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.947584 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108cedee-1642-499a-986c-d17e428a070a" containerName="test-curl-7428-140194905745712" Jul 16 21:28:59.947643 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.947600 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="108cedee-1642-499a-986c-d17e428a070a" containerName="test-curl-7428-140194905745712" Jul 16 21:28:59.947692 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.947682 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="108cedee-1642-499a-986c-d17e428a070a" containerName="test-curl-7428-140194905745712" Jul 16 21:28:59.950684 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.950669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:28:59.956824 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:28:59.956799 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:29:00.010529 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.010494 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2gx6\" (UniqueName: \"kubernetes.io/projected/108cedee-1642-499a-986c-d17e428a070a-kube-api-access-p2gx6\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:29:00.111175 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.111133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59jc2\" (UniqueName: \"kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2\") pod \"test-curl-7428-140194905745712\" (UID: \"05fc39c4-a4c6-4149-84ae-54372e3169c8\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:00.212736 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.212626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59jc2\" (UniqueName: \"kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2\") pod \"test-curl-7428-140194905745712\" (UID: \"05fc39c4-a4c6-4149-84ae-54372e3169c8\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:00.221144 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.221118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59jc2\" (UniqueName: \"kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2\") pod \"test-curl-7428-140194905745712\" (UID: \"05fc39c4-a4c6-4149-84ae-54372e3169c8\") " pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:00.261812 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.261775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:00.397378 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.397353 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:29:00.398926 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:29:00.398887 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05fc39c4_a4c6_4149_84ae_54372e3169c8.slice/crio-1c770e8888586ecd5c2f36c0b08af6aa6a3ac062fad18b3c9b41794ec83e4d9b WatchSource:0}: Error finding container 1c770e8888586ecd5c2f36c0b08af6aa6a3ac062fad18b3c9b41794ec83e4d9b: Status 404 returned error can't find the container with id 1c770e8888586ecd5c2f36c0b08af6aa6a3ac062fad18b3c9b41794ec83e4d9b Jul 16 21:29:00.642561 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.642527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905745712" event={"ID":"05fc39c4-a4c6-4149-84ae-54372e3169c8","Type":"ContainerStarted","Data":"1c770e8888586ecd5c2f36c0b08af6aa6a3ac062fad18b3c9b41794ec83e4d9b"} Jul 16 21:29:00.643823 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.643799 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:00.643962 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.643830 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15a4d7257fbcec68207d710a7acb1acb2d8b1ab5db3be1c9c84af94a16706c5f" Jul 16 21:29:00.655001 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:00.654975 2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7428-140194905745712" oldPodUID="108cedee-1642-499a-986c-d17e428a070a" podUID="05fc39c4-a4c6-4149-84ae-54372e3169c8" Jul 16 21:29:01.261622 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:01.261590 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="108cedee-1642-499a-986c-d17e428a070a" path="/var/lib/kubelet/pods/108cedee-1642-499a-986c-d17e428a070a/volumes" Jul 16 21:29:01.651746 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:01.651706 2563 generic.go:356] "Generic (PLEG): container finished" podID="05fc39c4-a4c6-4149-84ae-54372e3169c8" containerID="d9d3a404f7e6bb1579f420abb5983e246b4646cd072d9c444b4b4f9b04f964fc" exitCode=0 Jul 16 21:29:01.651891 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:01.651801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7428-140194905745712" event={"ID":"05fc39c4-a4c6-4149-84ae-54372e3169c8","Type":"ContainerDied","Data":"d9d3a404f7e6bb1579f420abb5983e246b4646cd072d9c444b4b4f9b04f964fc"} Jul 16 21:29:02.793293 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.793269 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:02.816927 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.816875 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7428-140194905745712_05fc39c4-a4c6-4149-84ae-54372e3169c8/test-curl-7428-140194905745712/0.log" Jul 16 21:29:02.843295 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.843266 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59jc2\" (UniqueName: \"kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2\") pod \"05fc39c4-a4c6-4149-84ae-54372e3169c8\" (UID: \"05fc39c4-a4c6-4149-84ae-54372e3169c8\") " Jul 16 21:29:02.844829 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.844811 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:29:02.845454 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.845432 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2" (OuterVolumeSpecName: "kube-api-access-59jc2") pod "05fc39c4-a4c6-4149-84ae-54372e3169c8" (UID: "05fc39c4-a4c6-4149-84ae-54372e3169c8"). InnerVolumeSpecName "kube-api-access-59jc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:29:02.850808 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.850778 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7428-140194905745712"] Jul 16 21:29:02.944024 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:02.943937 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59jc2\" (UniqueName: \"kubernetes.io/projected/05fc39c4-a4c6-4149-84ae-54372e3169c8-kube-api-access-59jc2\") on node \"ip-10-0-137-238.ec2.internal\" DevicePath \"\"" Jul 16 21:29:03.260565 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:03.260486 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05fc39c4-a4c6-4149-84ae-54372e3169c8" path="/var/lib/kubelet/pods/05fc39c4-a4c6-4149-84ae-54372e3169c8/volumes" Jul 16 21:29:03.665505 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:03.665474 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7428-140194905745712" Jul 16 21:29:03.665709 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:03.665518 2563 scope.go:117] "RemoveContainer" containerID="d9d3a404f7e6bb1579f420abb5983e246b4646cd072d9c444b4b4f9b04f964fc" Jul 16 21:29:03.701971 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:03.701937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:03.801720 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:03.801684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:13.659757 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:13.659722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:18.151146 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:18.151105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:21.945386 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:21.945346 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:24.271134 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:24.271102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:24.371447 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:24.371410 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:28.866236 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:28.866202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:29.128928 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:29.128831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:29.816578 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:29.816540 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:29.889140 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:29.889098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:39.814510 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:39.814462 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:44.319249 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:44.319213 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:50.362844 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:50.362759 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:50.459357 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:50.459325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:55.034948 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:55.034889 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:55.263363 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:55.263327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:29:55.692487 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:29:55.692451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59568f5c74-dxl29_72648fa1-677d-4d9f-9104-eec80532b941/authorino/0.log" Jul 16 21:30:01.592309 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:01.592276 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54cbbd8d77-rsghj_fe06b107-35dd-4a73-809a-e14842d34485/manager/0.log" Jul 16 21:30:01.975260 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:01.975233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fdbbf655-dwclj_83cafe49-3f0d-4e04-bf2f-09c5965ef686/copy-manifests/0.log" Jul 16 21:30:01.982133 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:01.982113 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fdbbf655-dwclj_83cafe49-3f0d-4e04-bf2f-09c5965ef686/manager/0.log" Jul 16 21:30:02.735332 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:02.735307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737245-g5pmk_ba19cc8b-1963-4856-bb52-b2efd497b1da/cleanup/0.log" Jul 16 21:30:04.021975 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:04.021936 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk"] Jul 16 21:30:04.024273 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:04.024245 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737245-g5pmk"] Jul 16 21:30:05.177478 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.177451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/util/0.log" Jul 16 21:30:05.184336 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.184314 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/pull/0.log" Jul 16 21:30:05.191477 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.191450 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/extract/0.log" Jul 16 21:30:05.260338 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.260309 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba19cc8b-1963-4856-bb52-b2efd497b1da" path="/var/lib/kubelet/pods/ba19cc8b-1963-4856-bb52-b2efd497b1da/volumes" Jul 16 21:30:05.311521 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.311493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/pull/0.log" Jul 16 21:30:05.318821 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.318800 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/extract/0.log" Jul 16 21:30:05.325484 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.325467 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/util/0.log" Jul 16 21:30:05.445010 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.444934 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/util/0.log" Jul 16 21:30:05.452009 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.451989 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/pull/0.log" Jul 16 21:30:05.458812 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.458794 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/extract/0.log" Jul 16 21:30:05.579291 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.579259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/util/0.log" Jul 16 21:30:05.586299 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.586276 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/pull/0.log" Jul 16 21:30:05.592708 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.592691 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/extract/0.log" Jul 16 21:30:05.715933 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:05.715834 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59568f5c74-dxl29_72648fa1-677d-4d9f-9104-eec80532b941/authorino/0.log" Jul 16 21:30:06.076523 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:06.076450 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9qnmg_661e5a8c-7665-4943-b601-024034df2426/kuadrant-console-plugin/0.log" Jul 16 21:30:07.292683 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:07.292647 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74779b8bd6-d652d_3481015d-0232-4d6d-ae4a-ce454b1ee27a/kube-auth-proxy/0.log" Jul 16 21:30:07.532785 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:07.532750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fxvvj_8535c133-28d1-43dd-b79b-3eca4f791a26/payload-pre-processing/0.log" Jul 16 21:30:08.270913 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:08.270884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-p96pm_838683f3-a874-4c8f-a2c2-ed9a2003d779/main/0.log" Jul 16 21:30:08.401577 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:08.401547 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cl58s_bf189063-2162-4f79-abe5-3767a00e5231/main/0.log" Jul 16 21:30:08.630387 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:08.630315 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zrrcr_de9254cd-9cce-4160-8e62-78694f5d7d67/main/0.log" Jul 16 21:30:14.664028 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:14.663994 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:30:14.732075 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:14.732044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:30:17.504718 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:17.504692 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xzdgg_2f77d1b0-90c0-4145-a051-2983b5759704/global-pull-secret-syncer/0.log" Jul 16 21:30:17.557782 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:17.557757 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" Jul 16 21:30:17.681666 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:17.681635 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-238.ec2.internal_1d1d3d8045e69f5dc2de7b2abaabfdb2/haproxy/0.log" Jul 16 21:30:22.401552 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.401520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/extract/0.log" Jul 16 21:30:22.428303 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.428280 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/util/0.log" Jul 16 21:30:22.463931 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.463898 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vsndl_6384a42c-58ec-4e60-9e22-aff62f703a6d/pull/0.log" Jul 16 21:30:22.492492 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.492476 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/extract/0.log" Jul 16 21:30:22.514695 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.514674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/util/0.log" Jul 16 21:30:22.537268 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.537248 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06dc6t_5c7a4715-fd89-424d-aa46-6ede9e299d72/pull/0.log" Jul 16 21:30:22.578737 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.578717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/extract/0.log" Jul 16 21:30:22.599540 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.599522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/util/0.log" Jul 16 21:30:22.621835 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.621815 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bv4v7_5c4f7686-e6b1-4f40-9430-f393228c5b58/pull/0.log" Jul 16 21:30:22.649773 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.649749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/extract/0.log" Jul 16 21:30:22.680739 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.680678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/util/0.log" Jul 16 21:30:22.703528 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.703507 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rks7h_15ac57f7-b7e3-4fbc-9561-d55f3578c919/pull/0.log" Jul 16 21:30:22.990601 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:22.990521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59568f5c74-dxl29_72648fa1-677d-4d9f-9104-eec80532b941/authorino/0.log" Jul 16 21:30:23.084654 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:23.084631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9qnmg_661e5a8c-7665-4943-b601-024034df2426/kuadrant-console-plugin/0.log" Jul 16 21:30:24.975948 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:24.975844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/alertmanager/0.log" Jul 16 21:30:25.004534 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.004505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/config-reloader/0.log" Jul 16 21:30:25.035725 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.035700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/kube-rbac-proxy-web/0.log" Jul 16 21:30:25.064388 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.064365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/kube-rbac-proxy/0.log" Jul 16 21:30:25.133555 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.133531 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/kube-rbac-proxy-metric/0.log" Jul 16 21:30:25.188862 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.188828 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/prom-label-proxy/0.log" Jul 16 21:30:25.242641 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.242569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_487b2e15-71b0-4c72-8895-eb377017d283/init-config-reloader/0.log" Jul 16 21:30:25.357500 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.357475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gpv8q_57af89b8-f248-4dec-a3d9-504f7aec4181/kube-state-metrics/0.log" Jul 16 21:30:25.397702 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.397671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gpv8q_57af89b8-f248-4dec-a3d9-504f7aec4181/kube-rbac-proxy-main/0.log" Jul 16 21:30:25.403184 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.403160 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpp89_a456e468-add5-4fce-ab3d-74fdd6b82a9c/konnectivity-agent/0.log" limit=1024 Jul 16 21:30:25.427312 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.427220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gpv8q_57af89b8-f248-4dec-a3d9-504f7aec4181/kube-rbac-proxy-self/0.log" Jul 16 21:30:25.463070 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.463045 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5df884696d-hrzdh_7568d7cf-3aa5-4fe3-ab38-4f8879dacc40/metrics-server/0.log" Jul 16 21:30:25.492259 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.492239 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-nmvrr_8b540ee5-3ade-4d45-a38b-0cae1d513d62/monitoring-plugin/0.log" Jul 16 21:30:25.521851 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.521785 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lsfdm_2f3b31eb-61a7-476d-b3be-2fc0b91e891d/node-exporter/0.log" Jul 16 21:30:25.544182 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.544165 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lsfdm_2f3b31eb-61a7-476d-b3be-2fc0b91e891d/kube-rbac-proxy/0.log" Jul 16 21:30:25.567961 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.567937 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lsfdm_2f3b31eb-61a7-476d-b3be-2fc0b91e891d/init-textfile/0.log" Jul 16 21:30:25.768472 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.768444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mkwp5_5049de09-9120-4652-a0fe-0ff76002990c/kube-rbac-proxy-main/0.log" Jul 16 21:30:25.792537 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.792484 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mkwp5_5049de09-9120-4652-a0fe-0ff76002990c/kube-rbac-proxy-self/0.log" Jul 16 21:30:25.820937 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:25.820895 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-mkwp5_5049de09-9120-4652-a0fe-0ff76002990c/openshift-state-metrics/0.log" Jul 16 21:30:26.028186 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.028157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8m4cw_7ec22871-595b-45b6-be9f-8d008a097585/prometheus-operator/0.log" Jul 16 21:30:26.047046 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.046980 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8m4cw_7ec22871-595b-45b6-be9f-8d008a097585/kube-rbac-proxy/0.log" Jul 16 21:30:26.071181 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.071153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-5q47g_c99158e7-e04e-4e26-a719-da9475e7ba57/prometheus-operator-admission-webhook/0.log" Jul 16 21:30:26.105783 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.105758 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6bb796bf-cq2qs_79638689-6b31-469b-9e9c-e68e9d7ee57f/telemeter-client/0.log" Jul 16 21:30:26.127583 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.127558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6bb796bf-cq2qs_79638689-6b31-469b-9e9c-e68e9d7ee57f/reload/0.log" Jul 16 21:30:26.150629 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.150605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6bb796bf-cq2qs_79638689-6b31-469b-9e9c-e68e9d7ee57f/kube-rbac-proxy/0.log" Jul 16 21:30:26.184528 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.184505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/thanos-query/0.log" Jul 16 21:30:26.207184 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.207160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/kube-rbac-proxy-web/0.log" Jul 16 21:30:26.228362 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.228343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/kube-rbac-proxy/0.log" Jul 16 21:30:26.254549 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.254527 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/prom-label-proxy/0.log" Jul 16 21:30:26.276658 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.276639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/kube-rbac-proxy-rules/0.log" Jul 16 21:30:26.298740 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:26.298690 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576754b96d-6qphd_f8639272-7910-4b06-a7d8-0c313794da90/kube-rbac-proxy-metrics/0.log" Jul 16 21:30:27.605643 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.605607 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf"] Jul 16 21:30:27.606073 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.606059 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05fc39c4-a4c6-4149-84ae-54372e3169c8" containerName="test-curl-7428-140194905745712" Jul 16 21:30:27.606073 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.606074 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="05fc39c4-a4c6-4149-84ae-54372e3169c8" containerName="test-curl-7428-140194905745712" Jul 16 21:30:27.606156 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.606139 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05fc39c4-a4c6-4149-84ae-54372e3169c8" containerName="test-curl-7428-140194905745712" Jul 16 21:30:27.609375 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.609355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.611653 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.611633 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7plfz\"/\"openshift-service-ca.crt\"" Jul 16 21:30:27.612561 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.612545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7plfz\"/\"default-dockercfg-pzbhc\"" Jul 16 21:30:27.612660 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.612571 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7plfz\"/\"kube-root-ca.crt\"" Jul 16 21:30:27.618886 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.618864 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf"] Jul 16 21:30:27.727193 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.727153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-proc\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.727382 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.727207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdmr\" (UniqueName: \"kubernetes.io/projected/1634d6fa-74ea-4b11-afb1-36432b2c4a50-kube-api-access-4hdmr\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.727382 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.727267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-lib-modules\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.727382 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.727288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-sys\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.727382 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.727317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-podres\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828065 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-podres\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828239 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828107 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-proc\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828239 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdmr\" (UniqueName: \"kubernetes.io/projected/1634d6fa-74ea-4b11-afb1-36432b2c4a50-kube-api-access-4hdmr\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828239 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-lib-modules\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828239 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-sys\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828239 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828227 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-proc\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828428 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828203 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-podres\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828428 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-lib-modules\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.828428 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.828291 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1634d6fa-74ea-4b11-afb1-36432b2c4a50-sys\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.837044 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.837012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdmr\" (UniqueName: \"kubernetes.io/projected/1634d6fa-74ea-4b11-afb1-36432b2c4a50-kube-api-access-4hdmr\") pod \"perf-node-gather-daemonset-2ncvf\" (UID: \"1634d6fa-74ea-4b11-afb1-36432b2c4a50\") " pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:27.920299 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:27.920277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:28.052863 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.052836 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf"] Jul 16 21:30:28.055346 ip-10-0-137-238 kubenswrapper[2563]: W0716 21:30:28.055316 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1634d6fa_74ea_4b11_afb1_36432b2c4a50.slice/crio-fe4e582c47339080993a567b010d836708f5eb24aa797b1a20ff8abe5c9f33b3 WatchSource:0}: Error finding container fe4e582c47339080993a567b010d836708f5eb24aa797b1a20ff8abe5c9f33b3: Status 404 returned error can't find the container with id fe4e582c47339080993a567b010d836708f5eb24aa797b1a20ff8abe5c9f33b3 Jul 16 21:30:28.159272 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.159242 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" event={"ID":"1634d6fa-74ea-4b11-afb1-36432b2c4a50","Type":"ContainerStarted","Data":"a906a32f6e1b4c68f54ce4115af1163c8b6419b20de15b7e65b630569e48f39a"} Jul 16 21:30:28.159401 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.159291 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" event={"ID":"1634d6fa-74ea-4b11-afb1-36432b2c4a50","Type":"ContainerStarted","Data":"fe4e582c47339080993a567b010d836708f5eb24aa797b1a20ff8abe5c9f33b3"} Jul 16 21:30:28.159401 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.159364 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:28.180860 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.180763 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" podStartSLOduration=1.180748764 podStartE2EDuration="1.180748764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:30:28.178699286 +0000 UTC m=+3451.437658740" watchObservedRunningTime="2026-07-16 21:30:28.180748764 +0000 UTC m=+3451.439708212" Jul 16 21:30:28.583391 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:28.583324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67474577d-gc76k_c2dda2fa-61a9-45b6-9971-fe89812f7b62/console/0.log" Jul 16 21:30:30.264258 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:30.264232 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6pj4_fa1eaf07-f6a7-4726-b783-231729af68ae/dns/0.log" Jul 16 21:30:30.289600 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:30.289579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s6pj4_fa1eaf07-f6a7-4726-b783-231729af68ae/kube-rbac-proxy/0.log" Jul 16 21:30:30.421336 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:30.421310 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dg5xf_a4652bec-5521-4362-851a-8f3e2f354408/dns-node-resolver/0.log" Jul 16 21:30:31.031686 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:31.031659 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xb7wj_ec56db27-8952-4624-9401-4a2d3a6ca985/node-ca/0.log" Jul 16 21:30:32.261823 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:32.261792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74779b8bd6-d652d_3481015d-0232-4d6d-ae4a-ce454b1ee27a/kube-auth-proxy/0.log" Jul 16 21:30:32.372830 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:32.372798 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fxvvj_8535c133-28d1-43dd-b79b-3eca4f791a26/payload-pre-processing/0.log" Jul 16 21:30:33.146607 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:33.146570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xgw6_7ba723ad-a6de-4209-a4fa-ca7492999cc4/serve-healthcheck-canary/0.log" Jul 16 21:30:33.786209 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:33.786180 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-697ss_45b26552-8266-4349-9d2a-ed154157feeb/kube-rbac-proxy/0.log" Jul 16 21:30:33.807290 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:33.807261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-697ss_45b26552-8266-4349-9d2a-ed154157feeb/exporter/0.log" Jul 16 21:30:33.828047 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:33.828023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-697ss_45b26552-8266-4349-9d2a-ed154157feeb/extractor/0.log" Jul 16 21:30:34.175897 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:34.175870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7plfz/perf-node-gather-daemonset-2ncvf" Jul 16 21:30:36.706926 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:36.706840 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54cbbd8d77-rsghj_fe06b107-35dd-4a73-809a-e14842d34485/manager/0.log" Jul 16 21:30:36.845714 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:36.845686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fdbbf655-dwclj_83cafe49-3f0d-4e04-bf2f-09c5965ef686/manager/0.log" Jul 16 21:30:36.870016 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:36.869994 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fdbbf655-dwclj_83cafe49-3f0d-4e04-bf2f-09c5965ef686/copy-manifests/0.log" Jul 16 21:30:37.824767 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:37.824697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74779b8bd6-d652d_3481015d-0232-4d6d-ae4a-ce454b1ee27a/kube-auth-proxy/0.log" Jul 16 21:30:37.904819 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:37.904792 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fxvvj_8535c133-28d1-43dd-b79b-3eca4f791a26/payload-pre-processing/0.log" Jul 16 21:30:38.413388 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:38.413350 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56b64d78d7-xx5r8_debee3c7-922d-40cb-a1e7-7a351acd4a0d/manager/0.log" Jul 16 21:30:38.446987 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:38.446967 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9r8wt_36e43a5e-5bb7-401a-b4c7-aca5a6aa59f9/openshift-lws-operator/0.log" Jul 16 21:30:39.416024 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:39.416001 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74779b8bd6-d652d_3481015d-0232-4d6d-ae4a-ce454b1ee27a/kube-auth-proxy/0.log" Jul 16 21:30:39.502636 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:39.502561 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fxvvj_8535c133-28d1-43dd-b79b-3eca4f791a26/payload-pre-processing/0.log" Jul 16 21:30:44.727285 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.727256 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/kube-multus-additional-cni-plugins/0.log" Jul 16 21:30:44.748594 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.748572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/egress-router-binary-copy/0.log" Jul 16 21:30:44.770696 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.770672 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/cni-plugins/0.log" Jul 16 21:30:44.792975 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.792944 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/bond-cni-plugin/0.log" Jul 16 21:30:44.814032 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.814014 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/routeoverride-cni/0.log" Jul 16 21:30:44.834346 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.834331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/whereabouts-cni-bincopy/0.log" Jul 16 21:30:44.856637 ip-10-0-137-238 kubenswrapper[2563]: I0716 21:30:44.856612 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9m64q_1134d2da-9d56-4185-89a5-f765178a5abd/whereabouts-cni/0.log"