Jul 22 12:51:49.757369 ip-10-0-134-155 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 12:51:49.757380 ip-10-0-134-155 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 12:51:49.757390 ip-10-0-134-155 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 12:51:49.757786 ip-10-0-134-155 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 12:51:59.790588 ip-10-0-134-155 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 22 12:51:59.790603 ip-10-0-134-155 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c27e498f76ea4c63b20ab02911e9ac0b -- Jul 22 12:53:48.811682 ip-10-0-134-155 systemd[1]: Starting Kubernetes Kubelet... Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.148089 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155228 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155242 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155246 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155249 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155253 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155255 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155259 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.181486 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155262 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155265 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155268 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155270 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155273 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155276 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155278 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155281 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155284 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155287 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155290 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155293 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155296 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155306 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155309 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155312 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155315 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155317 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155320 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155322 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.183195 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155325 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155327 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155330 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155332 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155336 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155338 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155341 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155344 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155346 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155349 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155351 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155354 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155357 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155359 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155362 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155364 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155367 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155369 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155371 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155374 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.190961 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155377 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155379 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155382 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155385 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155400 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155404 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155408 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155411 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155414 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155417 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155419 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155422 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155425 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155427 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155430 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155432 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155434 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155437 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155440 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155442 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.203386 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155444 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155448 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155451 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155453 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155455 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155460 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155463 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155466 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155468 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155471 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155474 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155477 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155479 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155482 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155485 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155488 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155492 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155496 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155499 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.226778 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155503 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.224539 ip-10-0-134-155 systemd[1]: Started Kubernetes Kubelet. Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155505 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155508 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155511 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155514 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155516 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155519 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155521 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155524 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155526 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155529 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155531 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.155534 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156211 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156217 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156221 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156224 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156226 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156229 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156231 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.240508 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156234 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156237 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156239 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156242 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156244 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156247 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156249 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156252 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156254 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156257 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156259 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156262 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156265 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156268 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156271 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156274 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156276 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156279 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156281 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156284 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.436149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156286 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156289 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156292 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156294 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156297 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156300 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156304 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156307 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156309 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156312 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156314 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156317 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156319 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156322 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156325 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156327 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156330 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156332 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156334 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156337 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.452311 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156339 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156342 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156345 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156347 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156350 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156352 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156359 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156362 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156364 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156367 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156370 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156372 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156375 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156378 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156380 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156383 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156385 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156407 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156411 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.454148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156414 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156417 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156419 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156422 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156425 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156428 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156431 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156434 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156436 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156439 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156442 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156445 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156449 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156452 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156456 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156458 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156461 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156464 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156466 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.454787 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156469 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156472 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156475 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156478 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156480 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156483 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156486 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156488 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156491 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156494 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156496 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156499 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156501 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156505 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156915 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156922 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156925 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156929 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156932 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.455823 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156935 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156937 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156940 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156943 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156948 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156951 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156954 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156957 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156959 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156962 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156966 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156970 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156973 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156976 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156980 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156983 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156986 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156988 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156991 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.459234 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156994 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156996 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.156999 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157002 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157004 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157008 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157011 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157013 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157016 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157018 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157021 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157024 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157026 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157029 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157031 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157034 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157036 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157041 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157043 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157047 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.459924 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157049 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157052 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157054 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157057 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157059 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157062 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157065 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157067 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157070 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157073 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157076 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157078 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157081 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157083 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157086 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157088 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157091 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157094 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157097 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157099 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.460649 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157102 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157105 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157107 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157110 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157112 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157115 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157118 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157120 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157122 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157128 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157131 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157134 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157137 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157141 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157144 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157148 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157151 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157153 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157156 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.461445 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157159 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157161 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157164 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157167 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157169 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157172 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157174 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157177 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157180 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157182 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157185 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157187 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157189 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157194 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157197 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157199 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157262 2549 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157269 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157275 2549 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157279 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157283 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 12:53:49.462146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157287 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157292 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157297 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157300 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157303 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157307 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157310 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157313 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157316 2549 flags.go:64] FLAG: --cgroup-root="" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157319 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157322 2549 flags.go:64] FLAG: --client-ca-file="" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157325 2549 flags.go:64] FLAG: --cloud-provider="external" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157328 2549 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157333 2549 flags.go:64] FLAG: --cluster-domain="" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157336 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157339 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157342 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157346 2549 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157350 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157353 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157356 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157359 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157362 2549 flags.go:64] FLAG: --contention-profiling="false" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157365 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 12:53:49.462937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157369 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157373 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157375 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157382 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157386 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157404 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157408 2549 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157411 2549 flags.go:64] FLAG: --enable-server="true" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157414 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157420 2549 flags.go:64] FLAG: --event-burst="100" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157423 2549 flags.go:64] FLAG: --event-qps="50" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157426 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157429 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157432 2549 flags.go:64] FLAG: --eviction-hard="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157436 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157439 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157442 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157445 2549 flags.go:64] FLAG: --eviction-soft="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157448 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157451 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157453 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157456 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157459 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157462 2549 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157466 2549 flags.go:64] FLAG: --feature-gates="" Jul 22 12:53:49.463821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157470 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157473 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157476 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157479 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157482 2549 flags.go:64] FLAG: --healthz-port="10248" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157485 2549 flags.go:64] FLAG: --help="false" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157488 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157493 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157496 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157498 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157502 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157505 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157508 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157511 2549 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157514 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157517 2549 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157522 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157525 2549 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157528 2549 flags.go:64] FLAG: --kube-reserved="" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157531 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157534 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157537 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157540 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157543 2549 flags.go:64] FLAG: --lock-file="" Jul 22 12:53:49.464531 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157546 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157549 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157552 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157557 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157560 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157563 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157566 2549 flags.go:64] FLAG: --logging-format="text" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157569 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157573 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157576 2549 flags.go:64] FLAG: --manifest-url="" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157579 2549 flags.go:64] FLAG: --manifest-url-header="" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157583 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157586 2549 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157590 2549 flags.go:64] FLAG: --max-pods="110" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157593 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157597 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157600 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157602 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157605 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157608 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157611 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157618 2549 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157621 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157624 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 12:53:49.465408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157628 2549 flags.go:64] FLAG: --pod-cidr="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157631 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157637 2549 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157640 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157643 2549 flags.go:64] FLAG: --pods-per-core="0" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157646 2549 flags.go:64] FLAG: --port="10250" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157649 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157652 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06ba0d4de33b022e3" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157655 2549 flags.go:64] FLAG: --qos-reserved="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157658 2549 flags.go:64] FLAG: --read-only-port="10255" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157661 2549 flags.go:64] FLAG: --register-node="true" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157664 2549 flags.go:64] FLAG: --register-with-taints="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157668 2549 flags.go:64] FLAG: --registry-burst="10" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157670 2549 flags.go:64] FLAG: --registry-qps="5" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157673 2549 flags.go:64] FLAG: --reserved-cpus="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157676 2549 flags.go:64] FLAG: --reserved-memory="" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157680 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157683 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157686 2549 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157689 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157692 2549 flags.go:64] FLAG: --runonce="false" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157695 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157698 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157702 2549 flags.go:64] FLAG: --seccomp-default="false" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157705 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 12:53:49.466159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157708 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157711 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157714 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157718 2549 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157720 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157723 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157726 2549 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157729 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157733 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157736 2549 flags.go:64] FLAG: --system-cgroups="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157739 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157744 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157747 2549 flags.go:64] FLAG: --tls-cert-file="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157750 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157754 2549 flags.go:64] FLAG: --tls-min-version="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157757 2549 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157760 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157763 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157766 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157769 2549 flags.go:64] FLAG: --v="2" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157773 2549 flags.go:64] FLAG: --version="false" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157777 2549 flags.go:64] FLAG: --vmodule="" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157780 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.157784 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 12:53:49.466957 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157898 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157903 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157906 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157910 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157913 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157916 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157920 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157923 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157926 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157929 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157932 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157935 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157937 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157940 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157943 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157946 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157951 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157953 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157956 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157959 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.467805 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157961 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157964 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157966 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157969 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157972 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157974 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157977 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157980 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157985 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157987 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157990 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157993 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157996 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.157999 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158002 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158005 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158007 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158010 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158014 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.468523 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158017 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158019 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158022 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158024 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158027 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158031 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158034 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158037 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158040 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158044 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158047 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158050 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158052 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158055 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158057 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158060 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158062 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158065 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158068 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158070 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.469218 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158073 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158076 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158078 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158081 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158083 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158085 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158088 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158091 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158094 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158097 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158099 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158103 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158106 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158108 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158111 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158113 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158116 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158119 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158121 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158124 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.601967 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158126 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158130 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158132 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158135 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158138 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158140 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158143 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158146 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158148 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158151 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158153 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158156 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158158 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158160 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158163 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158166 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158168 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158171 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158173 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.602866 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.158176 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.158184 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167167 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167184 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167204 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167209 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167266 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167271 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167274 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167276 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167279 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167282 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167285 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167288 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167291 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.603382 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167294 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167297 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167300 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167302 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167305 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167308 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167312 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167314 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167317 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167320 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167322 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167325 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167327 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167330 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167332 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167337 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167340 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167343 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167346 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167349 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.603853 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167352 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167355 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167357 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167360 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167363 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167365 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167368 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167370 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167373 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167375 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167378 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167380 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167383 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167387 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167407 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167410 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167413 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167417 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167421 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.604413 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167424 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167426 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167429 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167432 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167435 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167438 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167440 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167443 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167448 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167451 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167453 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167456 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167459 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167463 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167466 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167468 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167471 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167473 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167476 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167478 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.604960 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167481 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167484 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167486 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167489 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167491 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167494 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167496 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167499 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167502 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167504 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167507 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167510 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167513 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167516 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167518 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167521 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167523 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167526 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167528 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167532 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.605535 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167537 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167540 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167542 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167545 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167548 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167552 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167554 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167557 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167559 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167562 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167565 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167571 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167683 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167688 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167691 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 12:53:49.606148 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167694 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167697 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167700 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167703 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167707 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167711 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167716 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167719 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167722 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167725 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167728 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167732 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167734 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167737 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167740 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167742 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167745 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167748 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167752 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 12:53:49.606676 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167756 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167759 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167762 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167766 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167769 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167772 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167775 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167778 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167781 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167784 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167786 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167789 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167792 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167795 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167797 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167800 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167802 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167805 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167807 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167810 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 12:53:49.607262 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167812 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167814 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167817 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167821 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167823 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167826 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167829 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167831 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167834 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167836 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167839 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167843 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167845 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167848 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167851 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167855 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167858 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167860 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167863 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167866 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 12:53:49.607942 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167868 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167871 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167873 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167876 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167879 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167881 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167884 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167887 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167889 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167892 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167894 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167897 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167900 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167902 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167905 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167908 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167911 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167913 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167916 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 12:53:49.608515 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167918 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167921 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167924 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167926 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167930 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167933 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167935 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167938 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167941 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167944 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167947 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167949 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167952 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167954 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167957 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167959 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167962 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 12:53:49.609084 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:49.167965 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.167969 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.168100 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.170843 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.171911 2549 server.go:1019] "Starting client certificate rotation" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.172015 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.172056 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.173803 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.177336 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.189749 2549 log.go:25] "Validated CRI v1 runtime API" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.192617 2549 log.go:25] "Validated CRI v1 image API" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.193373 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 12:53:49.609568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.195430 2549 fs.go:135] Filesystem UUIDs: map[50256554-0da6-4aba-ba4b-1fb1e304b6fa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b286da7e-85c7-4b80-8934-bc253214d5cd:/dev/nvme0n1p3] Jul 22 12:53:49.609944 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.195443 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 12:53:49.609944 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.201069 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.202162 2549 manager.go:216] Machine: {Timestamp:2026-07-22 12:53:49.201139125 +0000 UTC m=+0.281900115 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098783 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec275d0eab502fb7988685b52fdb89a0 SystemUUID:ec275d0e-ab50-2fb7-9886-85b52fdb89a0 BootID:c27e498f-76ea-4c63-b20a-b02911e9ac0b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:75:b8:78:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:75:b8:78:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:99:e1:38:e9:f4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.202281 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.202361 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.203813 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.203847 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.209204 2549 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.209219 2549 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.209228 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.209243 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.210419 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214120 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214232 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214260 2549 kubelet.go:486] "Attempting to sync node with API server" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214269 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214280 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214290 2549 kubelet.go:398] "Adding apiserver pod source" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214299 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 12:53:49.610114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214678 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.214693 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.216560 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.218659 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.218691 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219671 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219687 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219696 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219703 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219715 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219722 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219731 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219741 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219750 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219759 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219768 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.219773 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.220236 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.220244 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.223717 2549 server.go:1268] "Started kubelet" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.223749 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.224543 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.224610 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.225484 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.225905 2549 server.go:310] "Adding debug handlers to kubelet server" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.226082 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.226337 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.226338 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.229161 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.231677 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.231695 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.231818 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232288 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232290 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232338 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232487 2549 reconstruct.go:97] "Volume reconstruction finished" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232499 2549 reconciler.go:29] "Reconciler: start to sync state" Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232598 2549 factory.go:55] Registering systemd factory Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232613 2549 factory.go:223] Registration of the systemd container factory successfully Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232874 2549 factory.go:153] Registering CRI-O factory Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232888 2549 factory.go:223] Registration of the crio container factory successfully Jul 22 12:53:49.610743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232941 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.232153 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-155.ec2.internal.18c49dc6bbafa9a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-155.ec2.internal,UID:ip-10-0-134-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-155.ec2.internal,},FirstTimestamp:2026-07-22 12:53:49.223496098 +0000 UTC m=+0.304257088,LastTimestamp:2026-07-22 12:53:49.223496098 +0000 UTC m=+0.304257088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-155.ec2.internal,}" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232983 2549 factory.go:103] Registering Raw factory Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.232997 2549 manager.go:1196] Started watching for new ooms in manager Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.233364 2549 manager.go:349] Starting recovery of all containers Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.239540 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.239677 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.247632 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fm4gb" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.249634 2549 manager.go:354] Recovery completed Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.254034 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.255578 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fm4gb" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.257638 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.257667 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.257679 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.258201 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.258211 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.258229 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.258254 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.259010 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.259030 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.259043 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.259213 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-155.ec2.internal.18c49dc6bdb8dac8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-155.ec2.internal,UID:ip-10-0-134-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-155.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-155.ec2.internal,},FirstTimestamp:2026-07-22 12:53:49.257652936 +0000 UTC m=+0.338413930,LastTimestamp:2026-07-22 12:53:49.257652936 +0000 UTC m=+0.338413930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-155.ec2.internal,}" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.260736 2549 policy_none.go:49] "None policy: Start" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.260759 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.260774 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.262841 2549 policy_none.go:47] "Start" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.301990 2549 manager.go:337] "Starting Device Plugin manager" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.302026 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302036 2549 server.go:87] "Starting device plugin registration server" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302278 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302287 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302387 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302522 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.302529 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 12:53:49.611869 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.302866 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.302912 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.353269 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.354416 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.354450 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.354472 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.354512 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.357083 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.403229 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.406802 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.406830 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.406839 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.406861 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.416230 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.416248 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-155.ec2.internal\": node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.441412 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.455495 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal"] Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.455566 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.459281 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.459309 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.459325 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.461452 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.461552 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.461579 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462100 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462104 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462162 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462179 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462134 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.462209 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.464432 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.464469 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.465102 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientMemory" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.465128 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.465138 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeHasSufficientPID" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.493952 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-155.ec2.internal\" not found" node="ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.499779 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-155.ec2.internal\" not found" node="ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.612762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.534336 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.613782 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.534359 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.613782 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.534374 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c0c76ea43c26f235062bbc97e0861a1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-155.ec2.internal\" (UID: \"6c0c76ea43c26f235062bbc97e0861a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.613782 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.542207 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635479 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635495 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c0c76ea43c26f235062bbc97e0861a1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-155.ec2.internal\" (UID: \"6c0c76ea43c26f235062bbc97e0861a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635544 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c0c76ea43c26f235062bbc97e0861a1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-155.ec2.internal\" (UID: \"6c0c76ea43c26f235062bbc97e0861a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635554 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.635562 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b009cbbe860e14f338ea237c3445e6e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal\" (UID: \"b009cbbe860e14f338ea237c3445e6e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.729884 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.642499 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.817362 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.743317 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:49.817362 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.797485 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.817362 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:49.803181 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:49.890019 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.844046 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:51.219813 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:49.944586 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:51.380029 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.239173 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:51.380029 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.339736 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-155.ec2.internal\" not found" Jul 22 12:53:51.380029 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.365891 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 12:53:51.380029 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.366021 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.388674 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.395995 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.408946 2549 apiserver.go:52] "Watching apiserver" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.417880 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.418231 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-7xb47","openshift-multus/multus-w5j5x","openshift-multus/network-metrics-daemon-rht2n","openshift-network-diagnostics/network-check-target-wt675","kube-system/konnectivity-agent-bfkv8","openshift-image-registry/node-ca-8phlh","openshift-multus/multus-additional-cni-plugins-kvhmm","openshift-network-operator/iptables-alerter-rgkv6","openshift-ovn-kubernetes/ovnkube-node-xpdfr","kube-system/global-pull-secret-syncer-6hcl6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg","openshift-cluster-node-tuning-operator/tuned-lndp5"] Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.420893 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.423256 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.423688 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.423708 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.423804 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68tlv\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425171 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.425237 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425594 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425806 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qjg7b\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425822 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425910 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.425918 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.426076 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.426095 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.427234 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.427305 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.429218 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.431588 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.431629 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.431651 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h29fb\"" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.431763 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432819 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-tmp-dir\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432855 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-os-release\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.468738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432876 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-netns\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432929 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-kubelet\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432966 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.432994 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433024 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-system-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433080 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cnibin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-bin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433132 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-daemon-config\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433155 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-etc-kubernetes\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-hosts-file\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433216 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxcl\" (UniqueName: \"kubernetes.io/projected/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-kube-api-access-xdxcl\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433246 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433272 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cni-binary-copy\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433298 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-socket-dir-parent\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433317 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-k8s-cni-cncf-io\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433334 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-multus\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-hostroot\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.469576 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433374 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-conf-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433401 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-multus-certs\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v8jd\" (UniqueName: \"kubernetes.io/projected/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-kube-api-access-4v8jd\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snldj\" (UniqueName: \"kubernetes.io/projected/e009cf55-84ed-4825-ab2b-6a218a079da4-kube-api-access-snldj\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.433954 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.434446 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.434503 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.434720 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9tcrr\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.436710 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.436901 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.438674 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-htm7z\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.438678 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.438720 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.438972 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.439336 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.439384 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.439386 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.439482 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4gk7r\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.439596 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.439692 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.441455 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.442141 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.442203 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.443587 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.443778 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bjlv\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.443783 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.443798 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.443968 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.445980 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal"] Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.446000 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.446089 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.470229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.446487 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.447022 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gb9p5\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.448621 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.448629 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449698 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449707 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449699 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k8f69\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449772 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449805 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449900 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.449952 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal"] Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.455010 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 12:48:50 +0000 UTC" deadline="2027-12-16 20:14:44.066444706 +0000 UTC" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.455039 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12295h20m52.611408124s" Jul 22 12:53:51.471103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.463479 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2lt4" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.471874 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2lt4" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.527189 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7jzv\" (UniqueName: \"kubernetes.io/projected/dc0e6a85-1e46-4560-8188-3319e91a9615-kube-api-access-m7jzv\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534389 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-kubelet\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534414 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534431 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/660eff52-5d24-445c-9824-fab142bdac50-iptables-alerter-script\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-system-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534464 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cnibin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534485 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-daemon-config\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534573 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-system-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534589 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cnibin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534598 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-conf\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534685 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-netns\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534718 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-netd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534744 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cni-binary-copy\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534839 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-k8s-cni-cncf-io\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.574954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534889 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-k8s-cni-cncf-io\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534892 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-multus-certs\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534932 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vn4n\" (UniqueName: \"kubernetes.io/projected/bfd48ef7-97ec-49a5-814e-33e59a99f155-kube-api-access-8vn4n\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534946 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-kubelet\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.534952 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-multus-certs\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535001 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-system-cni-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535055 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535081 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgbq5\" (UniqueName: \"kubernetes.io/projected/660eff52-5d24-445c-9824-fab142bdac50-kube-api-access-wgbq5\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535106 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snldj\" (UniqueName: \"kubernetes.io/projected/e009cf55-84ed-4825-ab2b-6a218a079da4-kube-api-access-snldj\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535149 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-device-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535192 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-etc-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535223 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535242 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-tmp-dir\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535257 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-kubernetes\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535294 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.580560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535327 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-kubelet-config\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535354 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-bin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535369 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-etc-kubernetes\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-config\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxcl\" (UniqueName: \"kubernetes.io/projected/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-kube-api-access-xdxcl\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535433 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535436 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-etc-kubernetes\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535443 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-bin\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535458 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v8jd\" (UniqueName: \"kubernetes.io/projected/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-kube-api-access-4v8jd\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535486 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmrcr\" (UniqueName: \"kubernetes.io/projected/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kube-api-access-cmrcr\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535495 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-tmp-dir\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535560 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-var-lib-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535669 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-cni-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-var-lib-kubelet\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535754 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-hostroot\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581351 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535785 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-conf-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535801 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275096cd-e634-4f35-9ddf-da60999b16c6-host\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535808 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-hostroot\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535825 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535860 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-conf-dir\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysconfig\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535904 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-lib-modules\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535945 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-tmp\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535961 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.535976 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536019 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-systemd-units\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536090 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-daemon-config\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-os-release\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536129 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/660eff52-5d24-445c-9824-fab142bdac50-host-slash\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.536145 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536171 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.536270 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:52.036244858 +0000 UTC m=+1.922881507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:51.581982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536284 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-cni-binary-copy\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536295 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275096cd-e634-4f35-9ddf-da60999b16c6-serviceca\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536320 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-systemd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536349 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536380 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc0e6a85-1e46-4560-8188-3319e91a9615-ovn-node-metrics-cert\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536419 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6z6l\" (UniqueName: \"kubernetes.io/projected/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-kube-api-access-m6z6l\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536448 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac76a3f1-3c25-499c-975d-af2dc2be92eb-agent-certs\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536464 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac76a3f1-3c25-499c-975d-af2dc2be92eb-konnectivity-ca\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536496 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-multus\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536565 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-tuned\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536580 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-var-lib-cni-multus\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536622 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-ovn\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536710 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-node-log\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-dbus\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536773 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-modprobe-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.709627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536829 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-env-overrides\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-script-lib\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536914 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-os-release\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.536965 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-netns\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537008 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537043 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537066 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-run\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537114 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-os-release\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537169 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-kubelet\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537187 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-host-run-netns\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537282 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cnibin\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-hosts-file\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-socket-dir-parent\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-sys\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537423 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-hosts-file\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-host\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-slash\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.710851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-log-socket\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537426 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-multus-socket-dir-parent\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537531 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjbs7\" (UniqueName: \"kubernetes.io/projected/275096cd-e634-4f35-9ddf-da60999b16c6-kube-api-access-qjbs7\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-systemd\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.537576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-bin\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.548682 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.548706 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.548721 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.548781 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:52.048762872 +0000 UTC m=+1.935399536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.548850 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.552132 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxcl\" (UniqueName: \"kubernetes.io/projected/8d55cadd-ccd6-4a92-8850-9a564ea8a2af-kube-api-access-xdxcl\") pod \"node-resolver-7xb47\" (UID: \"8d55cadd-ccd6-4a92-8850-9a564ea8a2af\") " pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.552162 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v8jd\" (UniqueName: \"kubernetes.io/projected/5d9a6bbb-9276-4bee-b302-9beb3b774ee7-kube-api-access-4v8jd\") pod \"multus-w5j5x\" (UID: \"5d9a6bbb-9276-4bee-b302-9beb3b774ee7\") " pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.552163 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snldj\" (UniqueName: \"kubernetes.io/projected/e009cf55-84ed-4825-ab2b-6a218a079da4-kube-api-access-snldj\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.637920 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-tuned\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.637964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-ovn\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.637991 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-node-log\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638043 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-ovn\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.711528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638049 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-node-log\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638073 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638099 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-dbus\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638116 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-modprobe-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638131 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-env-overrides\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638149 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-script-lib\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638190 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638182 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-dbus\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638236 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-modprobe-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638276 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-run\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638294 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-registration-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-kubelet\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cnibin\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638347 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-sys\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638367 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-host\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638388 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-slash\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638408 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-log-socket\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638416 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-sys\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638414 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cnibin\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638432 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjbs7\" (UniqueName: \"kubernetes.io/projected/275096cd-e634-4f35-9ddf-da60999b16c6-kube-api-access-qjbs7\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638363 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-run\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638457 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-host\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638466 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-systemd\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638503 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-bin\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638544 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-kubelet\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638549 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7jzv\" (UniqueName: \"kubernetes.io/projected/dc0e6a85-1e46-4560-8188-3319e91a9615-kube-api-access-m7jzv\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638577 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638584 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-slash\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638505 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-systemd\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638603 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/660eff52-5d24-445c-9824-fab142bdac50-iptables-alerter-script\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638630 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-bin\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638632 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638657 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638663 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-conf\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.712803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638676 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638695 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-netns\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638699 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-log-socket\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638728 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-env-overrides\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638762 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-netns\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638801 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-conf\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638806 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-socket-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638837 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-netd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638861 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vn4n\" (UniqueName: \"kubernetes.io/projected/bfd48ef7-97ec-49a5-814e-33e59a99f155-kube-api-access-8vn4n\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638873 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-cni-netd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638885 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-system-cni-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638910 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638918 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-script-lib\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638936 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgbq5\" (UniqueName: \"kubernetes.io/projected/660eff52-5d24-445c-9824-fab142bdac50-kube-api-access-wgbq5\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-device-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638986 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-etc-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639009 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.713656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639033 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-kubernetes\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639055 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639064 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.638921 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-system-cni-dir\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639103 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-kubernetes\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639123 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-kubelet-config\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639055 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-device-dir\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639153 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-config\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639161 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-etc-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639180 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-kubelet-config\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639209 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639225 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-sys-fs\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639240 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmrcr\" (UniqueName: \"kubernetes.io/projected/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kube-api-access-cmrcr\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639266 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639290 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-var-lib-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-var-lib-kubelet\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275096cd-e634-4f35-9ddf-da60999b16c6-host\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639376 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysconfig\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-lib-modules\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639471 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-tmp\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639494 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639499 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acf8cdc7-b618-40bc-acd1-f6d0186393b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639507 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysctl-d\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639379 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/660eff52-5d24-445c-9824-fab142bdac50-iptables-alerter-script\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639553 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639553 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639581 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-sysconfig\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639601 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-run-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639609 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275096cd-e634-4f35-9ddf-da60999b16c6-host\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639645 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-lib-modules\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639671 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd48ef7-97ec-49a5-814e-33e59a99f155-var-lib-kubelet\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.714749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639647 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-var-lib-openvswitch\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639706 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-systemd-units\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639731 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-os-release\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639757 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-systemd-units\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639775 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc0e6a85-1e46-4560-8188-3319e91a9615-ovnkube-config\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639777 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/660eff52-5d24-445c-9824-fab142bdac50-host-slash\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639809 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/660eff52-5d24-445c-9824-fab142bdac50-host-slash\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639824 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639837 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-os-release\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639872 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275096cd-e634-4f35-9ddf-da60999b16c6-serviceca\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.639892 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-systemd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:51.639961 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:52.139942921 +0000 UTC m=+2.026579572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639973 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639976 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc0e6a85-1e46-4560-8188-3319e91a9615-run-systemd\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.639991 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc0e6a85-1e46-4560-8188-3319e91a9615-ovn-node-metrics-cert\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6z6l\" (UniqueName: \"kubernetes.io/projected/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-kube-api-access-m6z6l\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640043 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac76a3f1-3c25-499c-975d-af2dc2be92eb-agent-certs\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640066 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac76a3f1-3c25-499c-975d-af2dc2be92eb-konnectivity-ca\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640332 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275096cd-e634-4f35-9ddf-da60999b16c6-serviceca\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640398 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-etc-tuned\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.640889 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ac76a3f1-3c25-499c-975d-af2dc2be92eb-konnectivity-ca\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.641593 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfd48ef7-97ec-49a5-814e-33e59a99f155-tmp\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.642346 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc0e6a85-1e46-4560-8188-3319e91a9615-ovn-node-metrics-cert\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.644748 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ac76a3f1-3c25-499c-975d-af2dc2be92eb-agent-certs\") pod \"konnectivity-agent-bfkv8\" (UID: \"ac76a3f1-3c25-499c-975d-af2dc2be92eb\") " pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.649030 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vn4n\" (UniqueName: \"kubernetes.io/projected/bfd48ef7-97ec-49a5-814e-33e59a99f155-kube-api-access-8vn4n\") pod \"tuned-lndp5\" (UID: \"bfd48ef7-97ec-49a5-814e-33e59a99f155\") " pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.650167 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjbs7\" (UniqueName: \"kubernetes.io/projected/275096cd-e634-4f35-9ddf-da60999b16c6-kube-api-access-qjbs7\") pod \"node-ca-8phlh\" (UID: \"275096cd-e634-4f35-9ddf-da60999b16c6\") " pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.650206 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgbq5\" (UniqueName: \"kubernetes.io/projected/660eff52-5d24-445c-9824-fab142bdac50-kube-api-access-wgbq5\") pod \"iptables-alerter-rgkv6\" (UID: \"660eff52-5d24-445c-9824-fab142bdac50\") " pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.650230 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6z6l\" (UniqueName: \"kubernetes.io/projected/2fe25ac5-1751-4f6e-97a3-b7e21a5b7121-kube-api-access-m6z6l\") pod \"multus-additional-cni-plugins-kvhmm\" (UID: \"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121\") " pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.650250 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmrcr\" (UniqueName: \"kubernetes.io/projected/acf8cdc7-b618-40bc-acd1-f6d0186393b0-kube-api-access-cmrcr\") pod \"aws-ebs-csi-driver-node-2ztsg\" (UID: \"acf8cdc7-b618-40bc-acd1-f6d0186393b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.651534 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7jzv\" (UniqueName: \"kubernetes.io/projected/dc0e6a85-1e46-4560-8188-3319e91a9615-kube-api-access-m7jzv\") pod \"ovnkube-node-xpdfr\" (UID: \"dc0e6a85-1e46-4560-8188-3319e91a9615\") " pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.715751 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.652805 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:53:51.750220 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.750186 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb009cbbe860e14f338ea237c3445e6e8.slice/crio-2d268cbbecbdef12dc8c4967cc29b92cfc047243110deaf860a4972157129db4 WatchSource:0}: Error finding container 2d268cbbecbdef12dc8c4967cc29b92cfc047243110deaf860a4972157129db4: Status 404 returned error can't find the container with id 2d268cbbecbdef12dc8c4967cc29b92cfc047243110deaf860a4972157129db4 Jul 22 12:53:51.750390 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.750376 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0c76ea43c26f235062bbc97e0861a1.slice/crio-8bc45d4686bda86e7d951147645456ee5ada6058bb88cbfb1b59fcd1471235ad WatchSource:0}: Error finding container 8bc45d4686bda86e7d951147645456ee5ada6058bb88cbfb1b59fcd1471235ad: Status 404 returned error can't find the container with id 8bc45d4686bda86e7d951147645456ee5ada6058bb88cbfb1b59fcd1471235ad Jul 22 12:53:51.754006 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.753989 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:53:51.784106 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.784082 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xb47" Jul 22 12:53:51.793145 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.793126 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d55cadd_ccd6_4a92_8850_9a564ea8a2af.slice/crio-622cdc5d5464c89137bc88540a8efed57060aea77af3dbdca94d7e8bd4b62a41 WatchSource:0}: Error finding container 622cdc5d5464c89137bc88540a8efed57060aea77af3dbdca94d7e8bd4b62a41: Status 404 returned error can't find the container with id 622cdc5d5464c89137bc88540a8efed57060aea77af3dbdca94d7e8bd4b62a41 Jul 22 12:53:51.807973 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.807956 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5j5x" Jul 22 12:53:51.815689 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.815670 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9a6bbb_9276_4bee_b302_9beb3b774ee7.slice/crio-f8b0d8d870b9eb41522378dbae37ec1af7c77408095556af7fc08e03fe801a7f WatchSource:0}: Error finding container f8b0d8d870b9eb41522378dbae37ec1af7c77408095556af7fc08e03fe801a7f: Status 404 returned error can't find the container with id f8b0d8d870b9eb41522378dbae37ec1af7c77408095556af7fc08e03fe801a7f Jul 22 12:53:51.815789 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.815734 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:53:51.823931 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.823913 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac76a3f1_3c25_499c_975d_af2dc2be92eb.slice/crio-ef29421e636498d3813ec21bc85e4ab47e66de589fb16c0ff693edca2d20237c WatchSource:0}: Error finding container ef29421e636498d3813ec21bc85e4ab47e66de589fb16c0ff693edca2d20237c: Status 404 returned error can't find the container with id ef29421e636498d3813ec21bc85e4ab47e66de589fb16c0ff693edca2d20237c Jul 22 12:53:51.861380 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.861356 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8phlh" Jul 22 12:53:51.869599 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.869577 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275096cd_e634_4f35_9ddf_da60999b16c6.slice/crio-5260fcf683c7a19b79aace42104c20229f930c6085387ccabc453c3dc2d98be3 WatchSource:0}: Error finding container 5260fcf683c7a19b79aace42104c20229f930c6085387ccabc453c3dc2d98be3: Status 404 returned error can't find the container with id 5260fcf683c7a19b79aace42104c20229f930c6085387ccabc453c3dc2d98be3 Jul 22 12:53:51.882929 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.882911 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" Jul 22 12:53:51.890726 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.890704 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe25ac5_1751_4f6e_97a3_b7e21a5b7121.slice/crio-810dd4703ea738f9b0e10391cac9b80cb7591b8c14c71c2c42135b04cf3a3d46 WatchSource:0}: Error finding container 810dd4703ea738f9b0e10391cac9b80cb7591b8c14c71c2c42135b04cf3a3d46: Status 404 returned error can't find the container with id 810dd4703ea738f9b0e10391cac9b80cb7591b8c14c71c2c42135b04cf3a3d46 Jul 22 12:53:51.901243 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.901227 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgkv6" Jul 22 12:53:51.904219 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.904202 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:53:51.909150 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.909132 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660eff52_5d24_445c_9824_fab142bdac50.slice/crio-dac7ecc2e275192bb973f506d94a1c340403bd3d28a9bbe6e19bc0431e596946 WatchSource:0}: Error finding container dac7ecc2e275192bb973f506d94a1c340403bd3d28a9bbe6e19bc0431e596946: Status 404 returned error can't find the container with id dac7ecc2e275192bb973f506d94a1c340403bd3d28a9bbe6e19bc0431e596946 Jul 22 12:53:51.922925 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.922905 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" Jul 22 12:53:51.930488 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.930469 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf8cdc7_b618_40bc_acd1_f6d0186393b0.slice/crio-b2f99a92b4da9f25a25d8f6fe90f98366a06ef86f5f9a2e9f2a3c1c3e8a39788 WatchSource:0}: Error finding container b2f99a92b4da9f25a25d8f6fe90f98366a06ef86f5f9a2e9f2a3c1c3e8a39788: Status 404 returned error can't find the container with id b2f99a92b4da9f25a25d8f6fe90f98366a06ef86f5f9a2e9f2a3c1c3e8a39788 Jul 22 12:53:51.941226 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:51.941208 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lndp5" Jul 22 12:53:51.949542 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:51.949502 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd48ef7_97ec_49a5_814e_33e59a99f155.slice/crio-c00edc6200fcb3acdd5fdb5326267c7f98dd5e6c7a49a1c7932973545bd58914 WatchSource:0}: Error finding container c00edc6200fcb3acdd5fdb5326267c7f98dd5e6c7a49a1c7932973545bd58914: Status 404 returned error can't find the container with id c00edc6200fcb3acdd5fdb5326267c7f98dd5e6c7a49a1c7932973545bd58914 Jul 22 12:53:52.042125 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.042095 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:52.042260 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.042217 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:52.042299 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.042265 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:53.042251089 +0000 UTC m=+2.928887734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:52.113371 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:53:52.113339 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0e6a85_1e46_4560_8188_3319e91a9615.slice/crio-5670aa79a0cf120647ae6c96490978fce1ba7cce4177385c371725f25caac959 WatchSource:0}: Error finding container 5670aa79a0cf120647ae6c96490978fce1ba7cce4177385c371725f25caac959: Status 404 returned error can't find the container with id 5670aa79a0cf120647ae6c96490978fce1ba7cce4177385c371725f25caac959 Jul 22 12:53:52.142453 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.142423 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:52.142637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.142471 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:52.142637 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142601 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:52.142637 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142621 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:53:52.142637 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142637 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:53:52.142836 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142650 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:52.142836 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142658 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:53.142642286 +0000 UTC m=+3.029278930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:52.142836 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.142698 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:53.14268215 +0000 UTC m=+3.029318799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:52.475431 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.475324 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:48:51 +0000 UTC" deadline="2028-01-13 15:34:40.536106679 +0000 UTC" Jul 22 12:53:52.475431 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.475383 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12962h40m48.060727787s" Jul 22 12:53:52.551929 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.551903 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:52.552128 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:52.552052 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:53:52.566428 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.566306 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xb47" event={"ID":"8d55cadd-ccd6-4a92-8850-9a564ea8a2af","Type":"ContainerStarted","Data":"622cdc5d5464c89137bc88540a8efed57060aea77af3dbdca94d7e8bd4b62a41"} Jul 22 12:53:52.594766 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.594667 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" event={"ID":"6c0c76ea43c26f235062bbc97e0861a1","Type":"ContainerStarted","Data":"8bc45d4686bda86e7d951147645456ee5ada6058bb88cbfb1b59fcd1471235ad"} Jul 22 12:53:52.601997 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.601893 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" event={"ID":"b009cbbe860e14f338ea237c3445e6e8","Type":"ContainerStarted","Data":"2d268cbbecbdef12dc8c4967cc29b92cfc047243110deaf860a4972157129db4"} Jul 22 12:53:52.608913 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.608783 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"5670aa79a0cf120647ae6c96490978fce1ba7cce4177385c371725f25caac959"} Jul 22 12:53:52.612548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.612508 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lndp5" event={"ID":"bfd48ef7-97ec-49a5-814e-33e59a99f155","Type":"ContainerStarted","Data":"c00edc6200fcb3acdd5fdb5326267c7f98dd5e6c7a49a1c7932973545bd58914"} Jul 22 12:53:52.615041 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.614984 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfkv8" event={"ID":"ac76a3f1-3c25-499c-975d-af2dc2be92eb","Type":"ContainerStarted","Data":"ef29421e636498d3813ec21bc85e4ab47e66de589fb16c0ff693edca2d20237c"} Jul 22 12:53:52.620259 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.620230 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" event={"ID":"acf8cdc7-b618-40bc-acd1-f6d0186393b0","Type":"ContainerStarted","Data":"b2f99a92b4da9f25a25d8f6fe90f98366a06ef86f5f9a2e9f2a3c1c3e8a39788"} Jul 22 12:53:52.624964 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.624936 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgkv6" event={"ID":"660eff52-5d24-445c-9824-fab142bdac50","Type":"ContainerStarted","Data":"dac7ecc2e275192bb973f506d94a1c340403bd3d28a9bbe6e19bc0431e596946"} Jul 22 12:53:52.630942 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.630905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerStarted","Data":"810dd4703ea738f9b0e10391cac9b80cb7591b8c14c71c2c42135b04cf3a3d46"} Jul 22 12:53:52.654426 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.654395 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8phlh" event={"ID":"275096cd-e634-4f35-9ddf-da60999b16c6","Type":"ContainerStarted","Data":"5260fcf683c7a19b79aace42104c20229f930c6085387ccabc453c3dc2d98be3"} Jul 22 12:53:52.667046 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.666985 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5j5x" event={"ID":"5d9a6bbb-9276-4bee-b302-9beb3b774ee7","Type":"ContainerStarted","Data":"f8b0d8d870b9eb41522378dbae37ec1af7c77408095556af7fc08e03fe801a7f"} Jul 22 12:53:52.943945 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:52.943702 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 12:53:53.053857 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.053819 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:53.054021 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.053891 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:53.054021 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.053961 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:55.053942544 +0000 UTC m=+4.940579192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:53.155211 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.155166 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:53.155387 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.155221 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:53.155450 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155385 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:53:53.155450 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155402 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:53:53.155450 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155415 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:53.155615 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155472 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:55.155452303 +0000 UTC m=+5.042088967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:53.155877 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155860 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:53.155937 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.155912 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:55.155896462 +0000 UTC m=+5.042533114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:53.476221 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.476151 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:48:51 +0000 UTC" deadline="2028-03-25 06:30:32.523780071 +0000 UTC" Jul 22 12:53:53.476221 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.476185 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14681h36m39.047599455s" Jul 22 12:53:53.550105 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.549293 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:53.550105 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.549420 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:53:53.550105 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:53.549854 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:53.550105 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:53.550047 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:53:54.550347 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:54.549908 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:54.550347 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:54.550022 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:53:55.073865 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:55.073818 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:55.074114 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.074084 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:55.074185 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.074146 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:59.074128283 +0000 UTC m=+8.960764934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:55.174718 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:55.174685 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:55.174891 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:55.174742 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:55.174891 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.174883 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:53:55.175001 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.174906 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:53:55.175001 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.174919 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:55.175001 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.174970 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:59.174952982 +0000 UTC m=+9.061589629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:55.175353 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.175334 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:55.175410 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.175386 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:53:59.175371896 +0000 UTC m=+9.062008546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:55.550366 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:55.549694 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:55.550366 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.549831 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:53:55.550366 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:55.550224 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:55.550366 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:55.550321 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:53:56.549848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:56.549815 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:56.550020 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:56.549921 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:53:57.549683 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:57.549614 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:57.549683 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:57.549659 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:57.550201 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:57.549752 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:53:57.550201 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:57.550155 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:53:58.549768 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:58.549741 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:58.550170 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:58.549873 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:53:59.109453 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:59.109416 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:59.109654 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.109616 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:59.109728 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.109694 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:07.109675112 +0000 UTC m=+16.996311757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:53:59.210746 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:59.210708 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:59.210922 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:59.210770 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:53:59.210922 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.210917 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:53:59.211050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.210923 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:59.211050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.210935 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:53:59.211050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.210952 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:59.211050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.211006 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:07.210982523 +0000 UTC m=+17.097619188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:53:59.211050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.211028 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:07.211017648 +0000 UTC m=+17.097654293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:53:59.549210 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:59.549122 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:53:59.549210 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:53:59.549177 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:53:59.549439 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.549271 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:53:59.549439 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:53:59.549408 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:00.552642 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:00.552611 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:00.553079 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:00.552921 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:01.549794 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:01.549764 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:01.549986 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:01.549764 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:01.549986 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:01.549911 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:01.550097 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:01.549983 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:02.550055 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:02.550002 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:02.550509 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:02.550175 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:03.549226 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:03.549192 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:03.549409 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:03.549334 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:03.549409 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:03.549366 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:03.549509 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:03.549438 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:04.549622 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:04.549586 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:04.550013 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:04.549714 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:05.549125 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:05.549093 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:05.549292 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:05.549227 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:05.549292 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:05.549246 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:05.549385 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:05.549362 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:06.549311 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:06.549059 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:06.549728 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:06.549406 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:07.166396 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:07.166363 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:07.166574 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.166511 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:54:07.166644 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.166593 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:23.166577177 +0000 UTC m=+33.053213822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:54:07.267592 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:07.267477 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:07.267592 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:07.267545 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267639 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267647 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267664 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267677 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267718 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:23.267701701 +0000 UTC m=+33.154338346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:54:07.267800 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.267734 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:23.267726823 +0000 UTC m=+33.154363467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:54:07.549036 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:07.548960 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:07.549208 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.549079 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:07.549208 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:07.549137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:07.549293 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:07.549252 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:08.549581 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:08.549532 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:08.550122 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:08.549673 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:09.549255 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:09.549222 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:09.549435 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:09.549354 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:09.549538 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:09.549222 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:09.549665 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:09.549626 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:10.549456 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:10.549423 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:10.549641 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:10.549510 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:11.549105 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:11.549073 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:11.549487 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:11.549169 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:11.549487 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:11.549236 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:11.549487 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:11.549341 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:12.549303 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.549137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:12.549908 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:12.549389 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:12.714288 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.714210 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" event={"ID":"acf8cdc7-b618-40bc-acd1-f6d0186393b0","Type":"ContainerStarted","Data":"7a08aae87e9610d2b998ee875ffd23fc5ff5d4e460638f15cb2624665b841590"} Jul 22 12:54:12.715656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.715632 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="c8215533044a7512bea86ab38f6ed8fb2d042f968f78ae1b5fa16eff672121cc" exitCode=0 Jul 22 12:54:12.715768 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.715701 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"c8215533044a7512bea86ab38f6ed8fb2d042f968f78ae1b5fa16eff672121cc"} Jul 22 12:54:12.717220 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.717178 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8phlh" event={"ID":"275096cd-e634-4f35-9ddf-da60999b16c6","Type":"ContainerStarted","Data":"f8daac0b222deea1c5e61df781cca137621068ff617448c2b27f1930533df4e9"} Jul 22 12:54:12.718573 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.718548 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5j5x" event={"ID":"5d9a6bbb-9276-4bee-b302-9beb3b774ee7","Type":"ContainerStarted","Data":"4c0c7b0c84425900c30c55b4c810b3343b261c9e95309f35fcfd2396d47d7d57"} Jul 22 12:54:12.719795 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.719777 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xb47" event={"ID":"8d55cadd-ccd6-4a92-8850-9a564ea8a2af","Type":"ContainerStarted","Data":"342ce350386c2b44478404617899f740435be5cbf396834c5baebd6c67087f10"} Jul 22 12:54:12.721040 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.721021 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" event={"ID":"6c0c76ea43c26f235062bbc97e0861a1","Type":"ContainerStarted","Data":"3796b6e0e6ff2b6544e71ce405adc43716e55e6410cddb7864382633d536773e"} Jul 22 12:54:12.722439 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.722418 2549 generic.go:356] "Generic (PLEG): container finished" podID="b009cbbe860e14f338ea237c3445e6e8" containerID="845a72b6dbdcf0e78c58b4ba6016505bbdf227283e389502d164d0e691e9ce51" exitCode=0 Jul 22 12:54:12.722538 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.722498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" event={"ID":"b009cbbe860e14f338ea237c3445e6e8","Type":"ContainerDied","Data":"845a72b6dbdcf0e78c58b4ba6016505bbdf227283e389502d164d0e691e9ce51"} Jul 22 12:54:12.725413 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725395 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"b090a6675b8dfe3f97a6ffce9a17c3856da010a74a3ec9ba1e1185638300a6e9"} Jul 22 12:54:12.725480 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725455 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"26b3731d6957c22d770b9e66278bccbc7c924cdf1f32ff06530527a63e182526"} Jul 22 12:54:12.725617 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725488 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"2869e3e28ad2dbadb287350bf6f83650c5da9d907d552313f4a53dcd09d13b15"} Jul 22 12:54:12.725617 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725541 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"f850a59da167638eea3e6a42b1524ab8af315c139d1adde7b4b80d14961c2cb7"} Jul 22 12:54:12.725617 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725569 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"d546c91a5bfbf6bf7a95c1d9eb0e453541bd1efc9b853164de52186288096f62"} Jul 22 12:54:12.725617 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.725607 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"480b585959536a9fdebdb072b60384f5dd3fa2752cd9fe498de29b75132643fc"} Jul 22 12:54:12.726680 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.726654 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lndp5" event={"ID":"bfd48ef7-97ec-49a5-814e-33e59a99f155","Type":"ContainerStarted","Data":"361043555bce24af244ca4ed9448591a31012904cb95f2a0bfc81cd5064cff83"} Jul 22 12:54:12.727810 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.727791 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfkv8" event={"ID":"ac76a3f1-3c25-499c-975d-af2dc2be92eb","Type":"ContainerStarted","Data":"87dd6a6fcaa8e6bf49ff8ea45a3306cdaf5e03b347992a02f31da049b1130453"} Jul 22 12:54:12.760298 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.760044 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bfkv8" podStartSLOduration=7.573550315 podStartE2EDuration="22.760027048s" totalImagesPullingTime="15.186476733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.75948059 +0000 UTC m=+22.646117258" watchObservedRunningTime="2026-07-22 12:54:12.760027048 +0000 UTC m=+22.646663715" Jul 22 12:54:12.830507 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.830455 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8phlh" podStartSLOduration=3.390779235 podStartE2EDuration="22.830433512s" totalImagesPullingTime="19.439654277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.829799629 +0000 UTC m=+22.716436298" watchObservedRunningTime="2026-07-22 12:54:12.830433512 +0000 UTC m=+22.717070180" Jul 22 12:54:12.854044 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.853987 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lndp5" podStartSLOduration=3.053263131 podStartE2EDuration="22.853966771s" totalImagesPullingTime="19.80070364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.853157677 +0000 UTC m=+22.739794366" watchObservedRunningTime="2026-07-22 12:54:12.853966771 +0000 UTC m=+22.740603457" Jul 22 12:54:12.870301 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.870242 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-155.ec2.internal" podStartSLOduration=21.870221787 podStartE2EDuration="21.870221787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.869619799 +0000 UTC m=+22.756256467" watchObservedRunningTime="2026-07-22 12:54:12.870221787 +0000 UTC m=+22.756858454" Jul 22 12:54:12.890346 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.890287 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7xb47" podStartSLOduration=3.032212091 podStartE2EDuration="22.89026851s" totalImagesPullingTime="19.858056419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.889845625 +0000 UTC m=+22.776482293" watchObservedRunningTime="2026-07-22 12:54:12.89026851 +0000 UTC m=+22.776905179" Jul 22 12:54:12.921241 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:12.921186 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w5j5x" podStartSLOduration=2.913378045 podStartE2EDuration="22.921171547s" totalImagesPullingTime="20.007793502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:12.920644379 +0000 UTC m=+22.807281046" watchObservedRunningTime="2026-07-22 12:54:12.921171547 +0000 UTC m=+22.807808214" Jul 22 12:54:13.549767 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.549729 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:13.550283 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.549774 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:13.550283 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:13.549866 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:13.550283 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:13.549982 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:13.731487 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.731456 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgkv6" event={"ID":"660eff52-5d24-445c-9824-fab142bdac50","Type":"ContainerStarted","Data":"90039527ad5e87139c5addb9d92c116aa70da332328bb76e75fef4e9edb3a199"} Jul 22 12:54:13.733510 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.733447 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" event={"ID":"b009cbbe860e14f338ea237c3445e6e8","Type":"ContainerStarted","Data":"eeae59b5b94c8ab57c8bea23705fd9d9ce9f9570d2987157000de265ace10878"} Jul 22 12:54:13.750030 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.749992 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rgkv6" podStartSLOduration=3.96482058 podStartE2EDuration="23.749978672s" totalImagesPullingTime="19.785158092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:13.749796252 +0000 UTC m=+23.636432921" watchObservedRunningTime="2026-07-22 12:54:13.749978672 +0000 UTC m=+23.636615340" Jul 22 12:54:13.766156 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.766106 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-155.ec2.internal" podStartSLOduration=22.766087902 podStartE2EDuration="22.766087902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:13.765537992 +0000 UTC m=+23.652174660" watchObservedRunningTime="2026-07-22 12:54:13.766087902 +0000 UTC m=+23.652724570" Jul 22 12:54:13.792729 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:13.792687 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 12:54:14.488934 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.488900 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:54:14.489502 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.489480 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:54:14.509827 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.509749 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T12:54:13.792726308Z","UUID":"51359261-cae3-4a39-ac32-8c5966ef4616","Handler":null,"Name":"","Endpoint":""} Jul 22 12:54:14.511385 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.511363 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 12:54:14.511486 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.511408 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 12:54:14.548967 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.548941 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:14.549108 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:14.549065 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:14.738897 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.738863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" event={"ID":"acf8cdc7-b618-40bc-acd1-f6d0186393b0","Type":"ContainerStarted","Data":"579ae474ab19d7ec75aa5a1291f9f416db80dd3f7190877f8cb9c5b408ffa573"} Jul 22 12:54:14.742953 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:14.742879 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"ca5feb56bce2d1e6ca5a892a5ef375953e3b4a1c1c1bfac0cb0ca6b21e8a72a7"} Jul 22 12:54:15.548788 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:15.548753 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:15.548788 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:15.548774 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:15.549122 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:15.548876 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:15.549122 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:15.549005 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:15.747595 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:15.747553 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" event={"ID":"acf8cdc7-b618-40bc-acd1-f6d0186393b0","Type":"ContainerStarted","Data":"841c2f0b447ae7a5af1b1b064fec4b3db1ca91e9ca308ae000431bf3cf8f66c3"} Jul 22 12:54:15.748081 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:15.747563 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 12:54:15.768146 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:15.768102 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ztsg" podStartSLOduration=3.450884661 podStartE2EDuration="25.768088198s" totalImagesPullingTime="22.317203537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:15.767726433 +0000 UTC m=+25.654363101" watchObservedRunningTime="2026-07-22 12:54:15.768088198 +0000 UTC m=+25.654724865" Jul 22 12:54:16.549749 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:16.549719 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:16.549931 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:16.549837 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:17.548975 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.548776 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:17.549490 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.548830 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:17.549490 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:17.549044 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:17.549490 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:17.549109 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:17.753556 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.753526 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="605700ec83ceb099ceab6f2682367c32936c9c99cbe42f641fb0ba842f8aa155" exitCode=0 Jul 22 12:54:17.753716 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.753614 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"605700ec83ceb099ceab6f2682367c32936c9c99cbe42f641fb0ba842f8aa155"} Jul 22 12:54:17.757225 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.757204 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" event={"ID":"dc0e6a85-1e46-4560-8188-3319e91a9615","Type":"ContainerStarted","Data":"3d2c44e9c6fffeb4c19db87cc4529a418b446ab485c9e38fcdb482d5ebed5deb"} Jul 22 12:54:17.757463 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.757449 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:17.757526 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.757508 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:17.757582 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.757560 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:17.772804 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.772784 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:17.772951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.772920 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:17.806342 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:17.806253 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" podStartSLOduration=7.109644652 podStartE2EDuration="26.80623579s" totalImagesPullingTime="19.696591138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:17.804737358 +0000 UTC m=+27.691374025" watchObservedRunningTime="2026-07-22 12:54:17.80623579 +0000 UTC m=+27.692872457" Jul 22 12:54:18.549590 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:18.549564 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:18.550161 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:18.549668 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:19.118070 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.117803 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hcl6"] Jul 22 12:54:19.118288 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.118203 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:19.119292 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:19.118340 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:19.121344 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.121317 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt675"] Jul 22 12:54:19.121449 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.121418 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:19.121539 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:19.121501 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:19.121904 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.121885 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rht2n"] Jul 22 12:54:19.121981 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.121970 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:19.122085 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:19.122064 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:19.764154 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.764123 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="a4b69af222640cde3cc41d83a0b902cf81ab85ad0c8725f5caea0ebe83dfb992" exitCode=0 Jul 22 12:54:19.764613 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:19.764212 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"a4b69af222640cde3cc41d83a0b902cf81ab85ad0c8725f5caea0ebe83dfb992"} Jul 22 12:54:20.550975 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:20.550944 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:20.551134 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:20.551072 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:20.921673 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:20.921639 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:54:20.922089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:20.921790 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 22 12:54:20.922202 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:20.922181 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bfkv8" Jul 22 12:54:21.549802 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:21.549772 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:21.549971 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:21.549810 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:21.549971 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:21.549892 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:21.550089 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:21.549993 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:21.771069 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:21.771036 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="84c7dc0ca34b145607a7bcb6f1517de4cf63fe028402f7c5da96b2b9461f4007" exitCode=0 Jul 22 12:54:21.771241 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:21.771120 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"84c7dc0ca34b145607a7bcb6f1517de4cf63fe028402f7c5da96b2b9461f4007"} Jul 22 12:54:22.548998 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:22.548969 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:22.549485 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:22.549092 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:23.188192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:23.188165 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:23.188353 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.188282 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:54:23.188353 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.188332 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:55.188318533 +0000 UTC m=+65.074955179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 12:54:23.289239 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:23.289205 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:23.289420 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:23.289283 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:23.289420 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289391 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 12:54:23.289551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289444 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret podName:ca56356c-b33f-4ca5-b2a9-0bcdd66fc141 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:55.289429657 +0000 UTC m=+65.176066302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret") pod "global-pull-secret-syncer-6hcl6" (UID: "ca56356c-b33f-4ca5-b2a9-0bcdd66fc141") : object "kube-system"/"original-pull-secret" not registered Jul 22 12:54:23.289551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289391 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 12:54:23.289551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289497 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 12:54:23.289551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289510 2549 projected.go:196] Error preparing data for projected volume kube-api-access-j6wkj for pod openshift-network-diagnostics/network-check-target-wt675: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:54:23.289714 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.289587 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj podName:ede0ebb5-902c-4234-bb64-2fa4e7bac371 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:55.289570836 +0000 UTC m=+65.176207481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j6wkj" (UniqueName: "kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj") pod "network-check-target-wt675" (UID: "ede0ebb5-902c-4234-bb64-2fa4e7bac371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 12:54:23.549827 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:23.549795 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:23.550193 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:23.549794 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:23.550193 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.549905 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wt675" podUID="ede0ebb5-902c-4234-bb64-2fa4e7bac371" Jul 22 12:54:23.550193 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:23.549998 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hcl6" podUID="ca56356c-b33f-4ca5-b2a9-0bcdd66fc141" Jul 22 12:54:24.549432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:24.549398 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:24.549640 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:24.549559 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rht2n" podUID="e009cf55-84ed-4825-ab2b-6a218a079da4" Jul 22 12:54:25.468808 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.468780 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-155.ec2.internal" event="NodeReady" Jul 22 12:54:25.469179 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.468928 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 12:54:25.503606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.503566 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:54:25.532427 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.532357 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bhn78"] Jul 22 12:54:25.532574 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.532467 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.535015 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.534990 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 12:54:25.535128 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.535083 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9xmtd\"" Jul 22 12:54:25.535204 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.535190 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 12:54:25.535356 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.535324 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 12:54:25.540844 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.540606 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 12:54:25.548397 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.548378 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-khhzp"] Jul 22 12:54:25.548499 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.548486 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.550868 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.550813 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 12:54:25.551037 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.551022 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 12:54:25.551118 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.551058 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6s9tz\"" Jul 22 12:54:25.570480 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570456 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:54:25.570594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570488 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhn78"] Jul 22 12:54:25.570594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570530 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-khhzp"] Jul 22 12:54:25.570594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570573 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:25.570594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570593 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:25.570798 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.570575 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.573248 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573230 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 12:54:25.573349 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573281 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 12:54:25.573349 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573296 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 12:54:25.573571 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573555 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 12:54:25.573680 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573593 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 12:54:25.573680 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573612 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 12:54:25.573680 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573615 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frnxs\"" Jul 22 12:54:25.573810 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.573679 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x9ndv\"" Jul 22 12:54:25.676530 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.676485 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.706705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.706765 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.706859 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skh2g\" (UniqueName: \"kubernetes.io/projected/cbca4457-c725-4b65-b816-02a9b5938f97-kube-api-access-skh2g\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.706916 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.706972 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c083c574-8de8-4c77-b48b-f5c11fea4d4a-cert\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.707003 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707003 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707037 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707061 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbca4457-c725-4b65-b816-02a9b5938f97-tmp-dir\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbca4457-c725-4b65-b816-02a9b5938f97-config-volume\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707145 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707169 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707196 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707250 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82vjk\" (UniqueName: \"kubernetes.io/projected/c083c574-8de8-4c77-b48b-f5c11fea4d4a-kube-api-access-82vjk\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.707432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.707284 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszkd\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.805182 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.805101 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:25.807977 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.807948 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszkd\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808040 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808067 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808092 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skh2g\" (UniqueName: \"kubernetes.io/projected/cbca4457-c725-4b65-b816-02a9b5938f97-kube-api-access-skh2g\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.808197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808122 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808150 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c083c574-8de8-4c77-b48b-f5c11fea4d4a-cert\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.808197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808173 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808381 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808198 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808381 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbca4457-c725-4b65-b816-02a9b5938f97-tmp-dir\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.808381 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808257 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbca4457-c725-4b65-b816-02a9b5938f97-config-volume\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.808537 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808446 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808537 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808492 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808648 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808545 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.808648 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808598 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82vjk\" (UniqueName: \"kubernetes.io/projected/c083c574-8de8-4c77-b48b-f5c11fea4d4a-kube-api-access-82vjk\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.808812 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808790 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.808812 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.808807 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbca4457-c725-4b65-b816-02a9b5938f97-config-volume\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.808929 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:25.808901 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:25.808929 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:25.808931 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:25.809107 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:25.808981 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:26.308963159 +0000 UTC m=+36.195599834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:25.809107 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:25.808906 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:25.809107 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.809057 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbca4457-c725-4b65-b816-02a9b5938f97-tmp-dir\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.809107 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:25.809063 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:26.309042869 +0000 UTC m=+36.195679516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:25.809331 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.809177 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.809331 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.809208 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.813014 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.812991 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.813150 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.813011 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.813150 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.813050 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c083c574-8de8-4c77-b48b-f5c11fea4d4a-cert\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.820171 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.820143 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skh2g\" (UniqueName: \"kubernetes.io/projected/cbca4457-c725-4b65-b816-02a9b5938f97-kube-api-access-skh2g\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:25.820704 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.820681 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.820798 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.820685 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82vjk\" (UniqueName: \"kubernetes.io/projected/c083c574-8de8-4c77-b48b-f5c11fea4d4a-kube-api-access-82vjk\") pod \"ingress-canary-khhzp\" (UID: \"c083c574-8de8-4c77-b48b-f5c11fea4d4a\") " pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:25.820798 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.820726 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszkd\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:25.887300 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:25.887266 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-khhzp" Jul 22 12:54:26.031585 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.031547 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:26.149157 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.148964 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:26.221118 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.221091 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-khhzp"] Jul 22 12:54:26.287305 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:26.287278 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc083c574_8de8_4c77_b48b_f5c11fea4d4a.slice/crio-5f68788583637972ab383f647c0d6a404719df1e662607883b9401ddc9910a25 WatchSource:0}: Error finding container 5f68788583637972ab383f647c0d6a404719df1e662607883b9401ddc9910a25: Status 404 returned error can't find the container with id 5f68788583637972ab383f647c0d6a404719df1e662607883b9401ddc9910a25 Jul 22 12:54:26.312441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.312420 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:26.312564 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.312449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:26.312619 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:26.312578 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:26.312619 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:26.312594 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:26.312691 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:26.312632 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:26.312691 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:26.312636 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:27.312622747 +0000 UTC m=+37.199259391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:26.312691 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:26.312678 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:27.312665661 +0000 UTC m=+37.199302305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:26.551800 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.551777 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:26.554628 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.554607 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 12:54:26.554744 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.554649 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsqrc\"" Jul 22 12:54:26.784479 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.784445 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-khhzp" event={"ID":"c083c574-8de8-4c77-b48b-f5c11fea4d4a","Type":"ContainerStarted","Data":"5f68788583637972ab383f647c0d6a404719df1e662607883b9401ddc9910a25"} Jul 22 12:54:26.787053 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.787029 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="b3b3a0f77c6490418183a163498e79c9b261efdf661f3d88f496edd9e30c7290" exitCode=0 Jul 22 12:54:26.787167 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:26.787067 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"b3b3a0f77c6490418183a163498e79c9b261efdf661f3d88f496edd9e30c7290"} Jul 22 12:54:27.320000 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.319969 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:27.320177 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.320017 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:27.320177 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:27.320128 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:27.320177 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:27.320146 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:27.320177 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:27.320154 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:27.320344 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:27.320204 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:29.320191051 +0000 UTC m=+39.206827696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:27.320344 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:27.320223 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:29.32021388 +0000 UTC m=+39.206850541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:27.341645 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.341611 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:27.398975 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.398946 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:27.793368 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.793336 2549 generic.go:356] "Generic (PLEG): container finished" podID="2fe25ac5-1751-4f6e-97a3-b7e21a5b7121" containerID="535701e11cc6e0c9c5065f47fa179beb31b3fe93a9145144dbc574e6f595b208" exitCode=0 Jul 22 12:54:27.793904 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:27.793415 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerDied","Data":"535701e11cc6e0c9c5065f47fa179beb31b3fe93a9145144dbc574e6f595b208"} Jul 22 12:54:28.800006 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:28.799854 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" event={"ID":"2fe25ac5-1751-4f6e-97a3-b7e21a5b7121","Type":"ContainerStarted","Data":"63c05d15a61939f4ea0df8f26b2eac8cdbecb94daab78fc4efaad63d225c378b"} Jul 22 12:54:28.825529 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:28.825478 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kvhmm" podStartSLOduration=7.908617507 podStartE2EDuration="38.825464162s" totalImagesPullingTime="30.916846655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:28.823824508 +0000 UTC m=+38.710461175" watchObservedRunningTime="2026-07-22 12:54:28.825464162 +0000 UTC m=+38.712100832" Jul 22 12:54:28.948035 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:28.947996 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:29.048080 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:29.047946 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:29.337397 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:29.337318 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:29.337397 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:29.337358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:29.337588 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:29.337538 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:29.337588 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:29.337549 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:29.337588 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:29.337556 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:29.337722 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:29.337610 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:33.337593654 +0000 UTC m=+43.224230298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:29.337722 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:29.337626 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:33.337620138 +0000 UTC m=+43.224256783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:29.803650 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:29.803613 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-khhzp" event={"ID":"c083c574-8de8-4c77-b48b-f5c11fea4d4a","Type":"ContainerStarted","Data":"9e5ef1fdf3810c12414e8275ffdd20964ce7e50f2c9318dc4897062107ce4081"} Jul 22 12:54:30.173257 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.173164 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-khhzp" podStartSLOduration=2.708507387 podStartE2EDuration="5.173143862s" totalImagesPullingTime="2.464636475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:29.818830362 +0000 UTC m=+39.705467030" watchObservedRunningTime="2026-07-22 12:54:30.173143862 +0000 UTC m=+40.059780507" Jul 22 12:54:30.173505 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.173491 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc"] Jul 22 12:54:30.177941 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.177917 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d6d8b6fd8-5cgh2"] Jul 22 12:54:30.178073 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.178031 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.181849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.181821 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 12:54:30.181849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.181844 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 12:54:30.182020 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.181925 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 12:54:30.182891 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.182870 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4j4nx\"" Jul 22 12:54:30.182991 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.182914 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 12:54:30.184166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.184141 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.187741 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187722 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187727 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j42v2\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187727 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187762 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187780 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187798 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 12:54:30.188047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.187811 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 12:54:30.188295 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.188063 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc"] Jul 22 12:54:30.193177 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.193154 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6d8b6fd8-5cgh2"] Jul 22 12:54:30.232220 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.232187 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:30.275723 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.275688 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7j42r"] Jul 22 12:54:30.288114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.288085 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.290060 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.290016 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7j42r"] Jul 22 12:54:30.290598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.290580 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 12:54:30.290687 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.290584 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 12:54:30.290909 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.290893 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 12:54:30.290964 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.290948 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 12:54:30.291890 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.291872 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c87m6\"" Jul 22 12:54:30.299866 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.299846 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 12:54:30.300183 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.300164 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:30.346864 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.346833 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwbd\" (UniqueName: \"kubernetes.io/projected/b4d27353-52e1-4e3d-8559-53a0955cdef5-kube-api-access-7hwbd\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.346864 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.346866 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b4d27353-52e1-4e3d-8559-53a0955cdef5-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.347046 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.346885 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-default-certificate\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.347046 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.347022 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.347109 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.347044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-stats-auth\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.347109 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.347083 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7fn\" (UniqueName: \"kubernetes.io/projected/545a4991-ecee-4898-b378-9b5d22d2b40e-kube-api-access-ws7fn\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.347166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.347110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.347166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.347127 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.358445 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.358421 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:30.448120 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448038 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bprr\" (UniqueName: \"kubernetes.io/projected/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-kube-api-access-6bprr\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.448120 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448076 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7fn\" (UniqueName: \"kubernetes.io/projected/545a4991-ecee-4898-b378-9b5d22d2b40e-kube-api-access-ws7fn\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.448120 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448100 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-serving-cert\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.448309 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448158 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-service-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.448309 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448231 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.448309 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448274 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.448402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448323 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.448402 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.448340 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:30.448402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.448402 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.448395 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.948376535 +0000 UTC m=+40.835013186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:30.448551 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448413 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwbd\" (UniqueName: \"kubernetes.io/projected/b4d27353-52e1-4e3d-8559-53a0955cdef5-kube-api-access-7hwbd\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.448551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.448439 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:30.448551 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448443 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-snapshots\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.448551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.448459 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.948445031 +0000 UTC m=+40.835081676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:30.448551 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.448496 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.948477704 +0000 UTC m=+40.835114363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:30.448719 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448564 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b4d27353-52e1-4e3d-8559-53a0955cdef5-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.448719 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448593 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-default-certificate\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.448719 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-stats-auth\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.448719 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.448654 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-tmp\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.449345 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.449321 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b4d27353-52e1-4e3d-8559-53a0955cdef5-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.451995 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.451973 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-stats-auth\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.452099 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.452076 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-default-certificate\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.457624 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.457603 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwbd\" (UniqueName: \"kubernetes.io/projected/b4d27353-52e1-4e3d-8559-53a0955cdef5-kube-api-access-7hwbd\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.458253 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.458235 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7fn\" (UniqueName: \"kubernetes.io/projected/545a4991-ecee-4898-b378-9b5d22d2b40e-kube-api-access-ws7fn\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.549049 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549019 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-tmp\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549224 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bprr\" (UniqueName: \"kubernetes.io/projected/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-kube-api-access-6bprr\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549224 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549119 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-serving-cert\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549224 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549148 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-service-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549384 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549233 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549384 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549309 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-snapshots\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549549 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549506 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-tmp\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549916 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549894 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-snapshots\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.549996 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.549926 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-service-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.550437 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.550413 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.551703 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.551680 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-serving-cert\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.558415 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.558396 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bprr\" (UniqueName: \"kubernetes.io/projected/05fd62ec-ad1e-4655-b4ce-0ee0c544c086-kube-api-access-6bprr\") pod \"insights-operator-555d9d7885-7j42r\" (UID: \"05fd62ec-ad1e-4655-b4ce-0ee0c544c086\") " pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.600305 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.600275 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-7j42r" Jul 22 12:54:30.752590 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.752561 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-7j42r"] Jul 22 12:54:30.755685 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:30.755658 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fd62ec_ad1e_4655_b4ce_0ee0c544c086.slice/crio-3b05ef77ca721b6f7ae6f66813a3039428062a3b6222d9900bdcd31fde97a697 WatchSource:0}: Error finding container 3b05ef77ca721b6f7ae6f66813a3039428062a3b6222d9900bdcd31fde97a697: Status 404 returned error can't find the container with id 3b05ef77ca721b6f7ae6f66813a3039428062a3b6222d9900bdcd31fde97a697 Jul 22 12:54:30.806991 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.806961 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7j42r" event={"ID":"05fd62ec-ad1e-4655-b4ce-0ee0c544c086","Type":"ContainerStarted","Data":"3b05ef77ca721b6f7ae6f66813a3039428062a3b6222d9900bdcd31fde97a697"} Jul 22 12:54:30.952077 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.952039 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:30.952242 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.952145 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:30.952242 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.952229 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:31.952208218 +0000 UTC m=+41.838844876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:30.952322 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.952295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.952362 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:30.952331 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:30.952427 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.952413 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:30.952459 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.952430 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:31.952412915 +0000 UTC m=+41.839049572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:30.952459 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:30.952457 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:31.95244603 +0000 UTC m=+41.839082683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:31.310916 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.310879 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:31.390805 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.390755 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:31.452546 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.452425 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:31.961089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.961051 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.961131 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:31.961156 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:31.961202 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:31.961269 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:33.961251145 +0000 UTC m=+43.847887794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:31.961290 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:31.961297 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:33.961290348 +0000 UTC m=+43.847926994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:31.961559 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:31.961333 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:33.961318787 +0000 UTC m=+43.847955446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:32.331039 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:32.331004 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:32.414310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:32.414276 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:33.289285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.289258 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:33.372766 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.372734 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:33.372897 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.372770 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:33.372897 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.372881 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:33.372897 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.372896 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:33.373010 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.372925 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:33.373010 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.372942 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:41.372926584 +0000 UTC m=+51.259563248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:33.373010 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.372976 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:41.372964769 +0000 UTC m=+51.259601417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:33.815468 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.815429 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7j42r" event={"ID":"05fd62ec-ad1e-4655-b4ce-0ee0c544c086","Type":"ContainerStarted","Data":"b64b0f49f5106502ff47ce435c161ebac68aa1dd85dcbad1c030968d0996d526"} Jul 22 12:54:33.833002 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.832946 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-7j42r" podStartSLOduration=1.34353366 podStartE2EDuration="3.832928289s" totalImagesPullingTime="2.489394629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:33.831015182 +0000 UTC m=+43.717651849" watchObservedRunningTime="2026-07-22 12:54:33.832928289 +0000 UTC m=+43.719564957" Jul 22 12:54:33.977271 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.977236 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:33.977445 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.977307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:33.977445 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:33.977333 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:33.977445 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.977397 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:33.977566 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.977469 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:37.977449746 +0000 UTC m=+47.864086415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:33.977566 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.977469 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:33.977566 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.977533 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:37.977492801 +0000 UTC m=+47.864129451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:33.977566 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:33.977563 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:37.97755221 +0000 UTC m=+47.864188859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:34.789794 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.789766 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rt8gp"] Jul 22 12:54:34.810935 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.810899 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rt8gp"] Jul 22 12:54:34.811145 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.811024 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.813659 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.813639 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 12:54:34.813763 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.813663 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dxxk2\"" Jul 22 12:54:34.814858 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.814834 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 12:54:34.832419 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.832394 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:34.884115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.884091 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqbxb\" (UniqueName: \"kubernetes.io/projected/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-api-access-cqbxb\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.884261 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.884151 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f4596c3-c593-42b8-b3a8-ddb750bd97db-crio-socket\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.884360 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.884331 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f4596c3-c593-42b8-b3a8-ddb750bd97db-data-volume\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.884399 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.884362 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.884552 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.884488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.895736 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.895708 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:34.985786 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.985748 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.985979 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.985795 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqbxb\" (UniqueName: \"kubernetes.io/projected/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-api-access-cqbxb\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.985979 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:34.985895 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:34.985979 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.985951 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f4596c3-c593-42b8-b3a8-ddb750bd97db-crio-socket\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.985979 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:34.985968 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:35.48595189 +0000 UTC m=+45.372588535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:34.986183 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.986041 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f4596c3-c593-42b8-b3a8-ddb750bd97db-data-volume\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.986183 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.986069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.986183 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:34.986132 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:54:34.986183 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.986134 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f4596c3-c593-42b8-b3a8-ddb750bd97db-crio-socket\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.986183 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:34.986161 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:35.486153874 +0000 UTC m=+45.372790532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : configmap "kube-rbac-proxy" not found Jul 22 12:54:34.986350 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.986338 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f4596c3-c593-42b8-b3a8-ddb750bd97db-data-volume\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:34.998732 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:34.998701 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqbxb\" (UniqueName: \"kubernetes.io/projected/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-api-access-cqbxb\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:35.135886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:35.135802 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:35.236376 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:35.236340 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:35.490089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:35.490008 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:35.490241 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:35.490114 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:35.490241 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:35.490157 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:35.490241 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:35.490172 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:54:35.490241 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:35.490231 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:36.490211834 +0000 UTC m=+46.376848481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:35.490373 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:35.490247 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:36.490240264 +0000 UTC m=+46.376876909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : configmap "kube-rbac-proxy" not found Jul 22 12:54:35.778914 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:35.778887 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xb47_8d55cadd-ccd6-4a92-8850-9a564ea8a2af/dns-node-resolver/0.log" Jul 22 12:54:36.171025 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.170938 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7"] Jul 22 12:54:36.192798 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.192774 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7"] Jul 22 12:54:36.192932 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.192897 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.195402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.195370 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.195538 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.195490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txc5z\" (UniqueName: \"kubernetes.io/projected/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-kube-api-access-txc5z\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.195538 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.195533 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5ctvz\"" Jul 22 12:54:36.195675 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.195532 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:54:36.196660 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.196643 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 12:54:36.196660 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.196653 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 12:54:36.296720 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.296685 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.296887 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.296743 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txc5z\" (UniqueName: \"kubernetes.io/projected/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-kube-api-access-txc5z\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.296933 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.296881 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:36.296981 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.296952 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:54:36.796934123 +0000 UTC m=+46.683570785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:36.307344 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.307318 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txc5z\" (UniqueName: \"kubernetes.io/projected/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-kube-api-access-txc5z\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.498255 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.498168 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:36.498422 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.498294 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:36.498422 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.498331 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:36.498422 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.498388 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:54:36.498422 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.498406 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:38.498387925 +0000 UTC m=+48.385024570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:36.498681 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.498428 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:38.4984176 +0000 UTC m=+48.385054245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : configmap "kube-rbac-proxy" not found Jul 22 12:54:36.579693 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.579662 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8phlh_275096cd-e634-4f35-9ddf-da60999b16c6/node-ca/0.log" Jul 22 12:54:36.800671 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:36.800639 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:36.800811 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.800789 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:36.800897 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:36.800887 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:54:37.800870174 +0000 UTC m=+47.687506823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:37.098019 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.097888 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:37.153310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.153280 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv"] Jul 22 12:54:37.157675 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.157649 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:37.174297 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.174275 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv"] Jul 22 12:54:37.174620 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.174379 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" Jul 22 12:54:37.176976 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.176958 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 12:54:37.178131 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.178115 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:54:37.178248 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.178228 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5hnt7\"" Jul 22 12:54:37.203896 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.203869 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2fc\" (UniqueName: \"kubernetes.io/projected/b58cf61d-cf7b-4991-99c3-18cb4bdacf69-kube-api-access-hl2fc\") pod \"volume-data-source-validator-78cf4c6f6-lhnbv\" (UID: \"b58cf61d-cf7b-4991-99c3-18cb4bdacf69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" Jul 22 12:54:37.305375 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.305347 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2fc\" (UniqueName: \"kubernetes.io/projected/b58cf61d-cf7b-4991-99c3-18cb4bdacf69-kube-api-access-hl2fc\") pod \"volume-data-source-validator-78cf4c6f6-lhnbv\" (UID: \"b58cf61d-cf7b-4991-99c3-18cb4bdacf69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" Jul 22 12:54:37.315043 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.315017 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2fc\" (UniqueName: \"kubernetes.io/projected/b58cf61d-cf7b-4991-99c3-18cb4bdacf69-kube-api-access-hl2fc\") pod \"volume-data-source-validator-78cf4c6f6-lhnbv\" (UID: \"b58cf61d-cf7b-4991-99c3-18cb4bdacf69\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" Jul 22 12:54:37.379211 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.379187 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-khhzp_c083c574-8de8-4c77-b48b-f5c11fea4d4a/serve-healthcheck-canary/0.log" Jul 22 12:54:37.483847 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.483814 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" Jul 22 12:54:37.613213 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.613135 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv"] Jul 22 12:54:37.616370 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:37.616346 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58cf61d_cf7b_4991_99c3_18cb4bdacf69.slice/crio-6336d364373e3129c53b14024f74187d6c0e2ab43f6daf22083d8f6f3068effd WatchSource:0}: Error finding container 6336d364373e3129c53b14024f74187d6c0e2ab43f6daf22083d8f6f3068effd: Status 404 returned error can't find the container with id 6336d364373e3129c53b14024f74187d6c0e2ab43f6daf22083d8f6f3068effd Jul 22 12:54:37.810501 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.810474 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:37.810665 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:37.810612 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:37.810708 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:37.810672 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:54:39.810655879 +0000 UTC m=+49.697292523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:37.824786 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:37.824754 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" event={"ID":"b58cf61d-cf7b-4991-99c3-18cb4bdacf69","Type":"ContainerStarted","Data":"6336d364373e3129c53b14024f74187d6c0e2ab43f6daf22083d8f6f3068effd"} Jul 22 12:54:38.011868 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.011838 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:38.012016 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.011894 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:38.012016 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.011921 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:38.012016 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.011991 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:38.012114 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.012018 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:38.012114 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.012042 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.01202302 +0000 UTC m=+55.898659686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:38.012114 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.012063 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.012055638 +0000 UTC m=+55.898692283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:38.012114 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.012073 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.012067782 +0000 UTC m=+55.898704427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:38.169120 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.169088 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-697sl"] Jul 22 12:54:38.185208 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.185181 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-697sl"] Jul 22 12:54:38.185644 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.185288 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.187905 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.187884 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:54:38.188075 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.188042 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 12:54:38.188075 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.188066 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 12:54:38.188245 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.188148 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 12:54:38.189856 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.189834 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wj22x\"" Jul 22 12:54:38.194026 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.193819 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 12:54:38.214005 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.213980 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-config\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.214179 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.214151 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6qp\" (UniqueName: \"kubernetes.io/projected/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-kube-api-access-zh6qp\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.214290 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.214273 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-serving-cert\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.214357 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.214341 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-trusted-ca\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.315316 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.315245 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-config\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.315457 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.315400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6qp\" (UniqueName: \"kubernetes.io/projected/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-kube-api-access-zh6qp\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.315500 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.315473 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-serving-cert\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.315560 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.315510 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-trusted-ca\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.315908 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.315888 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-config\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.317801 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.317782 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-serving-cert\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.324310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.324285 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6qp\" (UniqueName: \"kubernetes.io/projected/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-kube-api-access-zh6qp\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.325030 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.325009 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9-trusted-ca\") pod \"console-operator-565b7b569d-697sl\" (UID: \"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9\") " pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.497313 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.497276 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:38.517365 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.517336 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:38.517495 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.517478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:38.517558 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.517484 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:38.517558 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.517546 2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 12:54:38.517639 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.517601 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:42.517580767 +0000 UTC m=+52.404217415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:38.517639 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:38.517620 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:42.517611039 +0000 UTC m=+52.404247686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : configmap "kube-rbac-proxy" not found Jul 22 12:54:38.635789 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.635714 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-697sl"] Jul 22 12:54:38.638021 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:38.637999 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fff89e9_77bc_4591_b4c2_5d5b36cf8aa9.slice/crio-d3d376c19ec1c5bf67a9f7418acbb220d0b0b2e7ee22ac9572c4aa907c74f7b7 WatchSource:0}: Error finding container d3d376c19ec1c5bf67a9f7418acbb220d0b0b2e7ee22ac9572c4aa907c74f7b7: Status 404 returned error can't find the container with id d3d376c19ec1c5bf67a9f7418acbb220d0b0b2e7ee22ac9572c4aa907c74f7b7 Jul 22 12:54:38.828637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:38.828594 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-697sl" event={"ID":"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9","Type":"ContainerStarted","Data":"d3d376c19ec1c5bf67a9f7418acbb220d0b0b2e7ee22ac9572c4aa907c74f7b7"} Jul 22 12:54:39.829275 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:39.829243 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:39.829757 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:39.829404 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:39.829757 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:39.829469 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:54:43.829449991 +0000 UTC m=+53.716086640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:39.832642 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:39.832615 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" event={"ID":"b58cf61d-cf7b-4991-99c3-18cb4bdacf69","Type":"ContainerStarted","Data":"414951ae7fdbea1716eaee34c904060cabdfe9cfb6ff43b602bdd8cc19ae0d2c"} Jul 22 12:54:39.848287 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:39.848238 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lhnbv" podStartSLOduration=1.164055129 podStartE2EDuration="2.84821946s" totalImagesPullingTime="1.684164331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:39.847579655 +0000 UTC m=+49.734216326" watchObservedRunningTime="2026-07-22 12:54:39.84821946 +0000 UTC m=+49.734856130" Jul 22 12:54:39.933664 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:39.933629 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:39.985034 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:39.984998 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:40.158640 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.158567 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht"] Jul 22 12:54:40.180676 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.180653 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht"] Jul 22 12:54:40.180810 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.180734 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.183288 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.183267 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 12:54:40.183406 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.183283 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:54:40.183636 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.183620 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 12:54:40.184533 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.184502 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8qjl7\"" Jul 22 12:54:40.184620 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.184551 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 12:54:40.233756 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.233731 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzsj2\" (UniqueName: \"kubernetes.io/projected/6fd07149-cb96-4cec-a953-8a805c0089e4-kube-api-access-jzsj2\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.233886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.233786 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fd07149-cb96-4cec-a953-8a805c0089e4-config\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.233886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.233867 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd07149-cb96-4cec-a953-8a805c0089e4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.268962 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.268919 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t"] Jul 22 12:54:40.277631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.277610 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.280606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.280555 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 12:54:40.280606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.280578 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 12:54:40.280774 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.280614 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 12:54:40.280919 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.280897 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 12:54:40.280998 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.280928 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cmk8q\"" Jul 22 12:54:40.281288 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.281268 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t"] Jul 22 12:54:40.335155 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335126 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fd07149-cb96-4cec-a953-8a805c0089e4-config\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.335326 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335172 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97119692-c8f1-4c97-ad24-b60a46dde183-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.335394 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335323 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd07149-cb96-4cec-a953-8a805c0089e4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.335394 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2n6\" (UniqueName: \"kubernetes.io/projected/97119692-c8f1-4c97-ad24-b60a46dde183-kube-api-access-vq2n6\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.335475 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335422 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97119692-c8f1-4c97-ad24-b60a46dde183-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.335547 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.335476 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsj2\" (UniqueName: \"kubernetes.io/projected/6fd07149-cb96-4cec-a953-8a805c0089e4-kube-api-access-jzsj2\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.337396 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.337380 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6fd07149-cb96-4cec-a953-8a805c0089e4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.340137 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.340116 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6fd07149-cb96-4cec-a953-8a805c0089e4-config\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.345019 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.344993 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzsj2\" (UniqueName: \"kubernetes.io/projected/6fd07149-cb96-4cec-a953-8a805c0089e4-kube-api-access-jzsj2\") pod \"service-ca-operator-5bcbc94c78-rbkht\" (UID: \"6fd07149-cb96-4cec-a953-8a805c0089e4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.435968 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.435896 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97119692-c8f1-4c97-ad24-b60a46dde183-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.436122 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.436046 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97119692-c8f1-4c97-ad24-b60a46dde183-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.436122 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.436093 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2n6\" (UniqueName: \"kubernetes.io/projected/97119692-c8f1-4c97-ad24-b60a46dde183-kube-api-access-vq2n6\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.456976 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.456954 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97119692-c8f1-4c97-ad24-b60a46dde183-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.457141 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.457124 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2n6\" (UniqueName: \"kubernetes.io/projected/97119692-c8f1-4c97-ad24-b60a46dde183-kube-api-access-vq2n6\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.465591 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.465570 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:40.471884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.471861 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/97119692-c8f1-4c97-ad24-b60a46dde183-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9t98t\" (UID: \"97119692-c8f1-4c97-ad24-b60a46dde183\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:40.489462 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.489440 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" Jul 22 12:54:40.606281 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:40.606245 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" Jul 22 12:54:41.124461 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.124427 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht"] Jul 22 12:54:41.139245 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.139225 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t"] Jul 22 12:54:41.197339 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:41.197302 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd07149_cb96_4cec_a953_8a805c0089e4.slice/crio-b873b9241e47df430bfbaa1825a8a6f4e65f801e6f10d149ba88f5a306ccda68 WatchSource:0}: Error finding container b873b9241e47df430bfbaa1825a8a6f4e65f801e6f10d149ba88f5a306ccda68: Status 404 returned error can't find the container with id b873b9241e47df430bfbaa1825a8a6f4e65f801e6f10d149ba88f5a306ccda68 Jul 22 12:54:41.197833 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:41.197815 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97119692_c8f1_4c97_ad24_b60a46dde183.slice/crio-7642345874ee47022a30fac11874fbe8a06f0951ad031945fd4cc7987b54e921 WatchSource:0}: Error finding container 7642345874ee47022a30fac11874fbe8a06f0951ad031945fd4cc7987b54e921: Status 404 returned error can't find the container with id 7642345874ee47022a30fac11874fbe8a06f0951ad031945fd4cc7987b54e921 Jul 22 12:54:41.445191 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.445162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:41.445191 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.445193 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:41.445374 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:41.445320 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 12:54:41.445374 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:41.445336 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db86bcdf4-lhr8c: secret "image-registry-tls" not found Jul 22 12:54:41.445437 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:41.445390 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls podName:dc968cce-c6a0-4b3b-96ca-c30853b8a2f6 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:57.44537281 +0000 UTC m=+67.332009456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls") pod "image-registry-6db86bcdf4-lhr8c" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6") : secret "image-registry-tls" not found Jul 22 12:54:41.445437 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:41.445411 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 12:54:41.445565 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:41.445446 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls podName:cbca4457-c725-4b65-b816-02a9b5938f97 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:57.445436321 +0000 UTC m=+67.332072966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls") pod "dns-default-bhn78" (UID: "cbca4457-c725-4b65-b816-02a9b5938f97") : secret "dns-default-metrics-tls" not found Jul 22 12:54:41.509101 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.509023 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:41.840323 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.840239 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/0.log" Jul 22 12:54:41.840323 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.840287 2549 generic.go:356] "Generic (PLEG): container finished" podID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" containerID="76bf74a11fe3629a60c798fed2d5ec604ebed25bd7dde226a2d932d9ceac1831" exitCode=255 Jul 22 12:54:41.840600 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.840321 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-697sl" event={"ID":"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9","Type":"ContainerDied","Data":"76bf74a11fe3629a60c798fed2d5ec604ebed25bd7dde226a2d932d9ceac1831"} Jul 22 12:54:41.840656 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.840622 2549 scope.go:117] "RemoveContainer" containerID="76bf74a11fe3629a60c798fed2d5ec604ebed25bd7dde226a2d932d9ceac1831" Jul 22 12:54:41.842659 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.842632 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" event={"ID":"97119692-c8f1-4c97-ad24-b60a46dde183","Type":"ContainerStarted","Data":"7642345874ee47022a30fac11874fbe8a06f0951ad031945fd4cc7987b54e921"} Jul 22 12:54:41.844805 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:41.844758 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" event={"ID":"6fd07149-cb96-4cec-a953-8a805c0089e4","Type":"ContainerStarted","Data":"b873b9241e47df430bfbaa1825a8a6f4e65f801e6f10d149ba88f5a306ccda68"} Jul 22 12:54:42.339834 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.339784 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:42.413123 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.413089 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:42.555792 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.555704 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:42.555954 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:42.555819 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:42.555954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.555856 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:42.555954 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:42.555885 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:54:50.55586491 +0000 UTC m=+60.442501557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:42.556383 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.556357 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f4596c3-c593-42b8-b3a8-ddb750bd97db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:42.849496 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.849417 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 12:54:42.849923 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.849900 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/0.log" Jul 22 12:54:42.850026 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.849945 2549 generic.go:356] "Generic (PLEG): container finished" podID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" containerID="8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c" exitCode=255 Jul 22 12:54:42.850026 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.850011 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-697sl" event={"ID":"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9","Type":"ContainerDied","Data":"8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c"} Jul 22 12:54:42.850128 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.850065 2549 scope.go:117] "RemoveContainer" containerID="76bf74a11fe3629a60c798fed2d5ec604ebed25bd7dde226a2d932d9ceac1831" Jul 22 12:54:42.850311 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.850293 2549 scope.go:117] "RemoveContainer" containerID="8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c" Jul 22 12:54:42.850562 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:42.850531 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-697sl_openshift-console-operator(4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9)\"" pod="openshift-console-operator/console-operator-565b7b569d-697sl" podUID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" Jul 22 12:54:42.906441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.906412 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr"] Jul 22 12:54:42.908929 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.908907 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" Jul 22 12:54:42.912348 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.912328 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-44zrl\"" Jul 22 12:54:42.927779 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.927746 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr"] Jul 22 12:54:42.959404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:42.959370 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skrg\" (UniqueName: \"kubernetes.io/projected/1d3f460b-f5ca-4cbc-9602-a273b2d1422f-kube-api-access-6skrg\") pod \"network-check-source-7bc5b6bf85-slhwr\" (UID: \"1d3f460b-f5ca-4cbc-9602-a273b2d1422f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" Jul 22 12:54:43.061047 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.061003 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6skrg\" (UniqueName: \"kubernetes.io/projected/1d3f460b-f5ca-4cbc-9602-a273b2d1422f-kube-api-access-6skrg\") pod \"network-check-source-7bc5b6bf85-slhwr\" (UID: \"1d3f460b-f5ca-4cbc-9602-a273b2d1422f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" Jul 22 12:54:43.070748 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.070720 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skrg\" (UniqueName: \"kubernetes.io/projected/1d3f460b-f5ca-4cbc-9602-a273b2d1422f-kube-api-access-6skrg\") pod \"network-check-source-7bc5b6bf85-slhwr\" (UID: \"1d3f460b-f5ca-4cbc-9602-a273b2d1422f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" Jul 22 12:54:43.218277 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.218187 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" Jul 22 12:54:43.629270 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.629223 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:43.721235 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.721203 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr"] Jul 22 12:54:43.724375 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:43.724340 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3f460b_f5ca_4cbc_9602_a273b2d1422f.slice/crio-60c436ab40d979b546a5c47bc25a05140b3fbc5995fe61bda04b1920fd35d473 WatchSource:0}: Error finding container 60c436ab40d979b546a5c47bc25a05140b3fbc5995fe61bda04b1920fd35d473: Status 404 returned error can't find the container with id 60c436ab40d979b546a5c47bc25a05140b3fbc5995fe61bda04b1920fd35d473 Jul 22 12:54:43.725426 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.725391 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:43.858738 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.858663 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 12:54:43.859053 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.859028 2549 scope.go:117] "RemoveContainer" containerID="8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c" Jul 22 12:54:43.859232 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:43.859211 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-697sl_openshift-console-operator(4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9)\"" pod="openshift-console-operator/console-operator-565b7b569d-697sl" podUID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" Jul 22 12:54:43.860022 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.859997 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" event={"ID":"1d3f460b-f5ca-4cbc-9602-a273b2d1422f","Type":"ContainerStarted","Data":"60c436ab40d979b546a5c47bc25a05140b3fbc5995fe61bda04b1920fd35d473"} Jul 22 12:54:43.861427 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.861402 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" event={"ID":"97119692-c8f1-4c97-ad24-b60a46dde183","Type":"ContainerStarted","Data":"45f12195904e054c871dda19aa5e0630aae9d6089164d392af834d5f3c29c102"} Jul 22 12:54:43.862809 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.862784 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" event={"ID":"6fd07149-cb96-4cec-a953-8a805c0089e4","Type":"ContainerStarted","Data":"63fd038357c7f0b3de708c7ab2b16443c977822d0d9d8dd227e2e1d501a9c794"} Jul 22 12:54:43.869696 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.869670 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:43.869833 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:43.869816 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:43.869900 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:43.869886 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:54:51.869866295 +0000 UTC m=+61.756502942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:43.892803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.892758 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" podStartSLOduration=1.521611051 podStartE2EDuration="3.892742596s" totalImagesPullingTime="2.371131545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:43.891583245 +0000 UTC m=+53.778219911" watchObservedRunningTime="2026-07-22 12:54:43.892742596 +0000 UTC m=+53.779379280" Jul 22 12:54:43.920624 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:43.920569 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" podStartSLOduration=1.548960075 podStartE2EDuration="3.920548257s" totalImagesPullingTime="2.371588182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:43.919596222 +0000 UTC m=+53.806232891" watchObservedRunningTime="2026-07-22 12:54:43.920548257 +0000 UTC m=+53.807184925" Jul 22 12:54:45.252067 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.252037 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.354845 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.354815 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.421249 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.421210 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.521789 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.521753 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.689626 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.689585 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.747639 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.747606 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:45.953431 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:45.953345 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:46.018745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.018713 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:46.093924 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.093894 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:54:46.094113 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.093970 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:46.094113 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.094001 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:54:46.094113 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:46.094067 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:46.094270 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:46.094145 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls podName:b4d27353-52e1-4e3d-8559-53a0955cdef5 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:02.094124875 +0000 UTC m=+71.980761532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w22gc" (UID: "b4d27353-52e1-4e3d-8559-53a0955cdef5") : secret "cluster-monitoring-operator-tls" not found Jul 22 12:54:46.094270 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:46.094150 2549 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 12:54:46.094270 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:46.094168 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:55:02.094158332 +0000 UTC m=+71.980794983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : configmap references non-existent config key: service-ca.crt Jul 22 12:54:46.094270 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:46.094200 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs podName:545a4991-ecee-4898-b378-9b5d22d2b40e nodeName:}" failed. No retries permitted until 2026-07-22 12:55:02.094183383 +0000 UTC m=+71.980820033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs") pod "router-default-5d6d8b6fd8-5cgh2" (UID: "545a4991-ecee-4898-b378-9b5d22d2b40e") : secret "router-metrics-certs-default" not found Jul 22 12:54:46.422087 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.422054 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:46.521710 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.521669 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:46.873998 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:46.873972 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" event={"ID":"1d3f460b-f5ca-4cbc-9602-a273b2d1422f","Type":"ContainerStarted","Data":"8065c799f8162cb3c3c0b109905f5ada2755e1ba5b0604fe2bf4c2594a273b0d"} Jul 22 12:54:47.611044 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:47.611002 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:47.678872 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:47.678844 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:47.784184 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:47.784151 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:47.895065 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:47.894975 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-slhwr" podStartSLOduration=2.832308832 podStartE2EDuration="5.89495984s" totalImagesPullingTime="3.062651008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:47.893495205 +0000 UTC m=+57.780131873" watchObservedRunningTime="2026-07-22 12:54:47.89495984 +0000 UTC m=+57.781596507" Jul 22 12:54:48.383134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.383098 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:48.444771 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.444736 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:48.498072 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.498048 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:48.498170 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.498098 2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:54:48.498421 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.498409 2549 scope.go:117] "RemoveContainer" containerID="8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c" Jul 22 12:54:48.498596 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:48.498578 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-697sl_openshift-console-operator(4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9)\"" pod="openshift-console-operator/console-operator-565b7b569d-697sl" podUID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" Jul 22 12:54:48.682162 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:48.682078 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:49.249212 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:49.249181 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:49.350553 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:49.350502 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:49.432762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:49.432731 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:49.774962 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:49.774929 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xpdfr" Jul 22 12:54:50.637134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:50.637086 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:54:50.637322 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:50.637217 2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 12:54:50.637322 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:50.637278 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls podName:0f4596c3-c593-42b8-b3a8-ddb750bd97db nodeName:}" failed. No retries permitted until 2026-07-22 12:55:06.637263702 +0000 UTC m=+76.523900348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rt8gp" (UID: "0f4596c3-c593-42b8-b3a8-ddb750bd97db") : secret "insights-runtime-extractor-tls" not found Jul 22 12:54:51.540272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:51.540234 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:51.947299 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:51.947213 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:54:51.947448 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:51.947354 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 12:54:51.947448 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:51.947414 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls podName:c4d3e742-2404-4bb2-8f4a-8f4f876493cd nodeName:}" failed. No retries permitted until 2026-07-22 12:55:07.947398078 +0000 UTC m=+77.834034723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6rgq7" (UID: "c4d3e742-2404-4bb2-8f4a-8f4f876493cd") : secret "samples-operator-tls" not found Jul 22 12:54:52.445290 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:52.445260 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:52.546153 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:52.546119 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:52.741502 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:52.741411 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:52.946966 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:52.946932 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:53.027235 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:53.027201 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:53.109619 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:53.109566 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:53.210178 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:53.210142 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:53.747138 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:53.747112 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:54.188095 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:54.188055 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:54.932503 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:54.932474 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.158228 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.158194 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.275510 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.275488 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:54:55.278322 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.278303 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 12:54:55.286552 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:55.286532 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 12:54:55.286607 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:54:55.286592 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs podName:e009cf55-84ed-4825-ab2b-6a218a079da4 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:59.286573216 +0000 UTC m=+129.173209869 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs") pod "network-metrics-daemon-rht2n" (UID: "e009cf55-84ed-4825-ab2b-6a218a079da4") : secret "metrics-daemon-secret" not found Jul 22 12:54:55.337998 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.337967 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.376865 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.376830 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:55.376958 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.376927 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:55.379197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.379176 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6wkj\" (UniqueName: \"kubernetes.io/projected/ede0ebb5-902c-4234-bb64-2fa4e7bac371-kube-api-access-j6wkj\") pod \"network-check-target-wt675\" (UID: \"ede0ebb5-902c-4234-bb64-2fa4e7bac371\") " pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:55.379626 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.379611 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 12:54:55.389633 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.389614 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca56356c-b33f-4ca5-b2a9-0bcdd66fc141-original-pull-secret\") pod \"global-pull-secret-syncer-6hcl6\" (UID: \"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141\") " pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:55.540762 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.540677 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.581509 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.581484 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hcl6" Jul 22 12:54:55.596085 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.596055 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frnxs\"" Jul 22 12:54:55.597494 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.597461 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.604378 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.604358 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:55.717568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.717538 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hcl6"] Jul 22 12:54:55.719990 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:55.719962 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca56356c_b33f_4ca5_b2a9_0bcdd66fc141.slice/crio-8624aac58454d897211b52b110d94d5204b15a144cc6bae2561449b63742bd66 WatchSource:0}: Error finding container 8624aac58454d897211b52b110d94d5204b15a144cc6bae2561449b63742bd66: Status 404 returned error can't find the container with id 8624aac58454d897211b52b110d94d5204b15a144cc6bae2561449b63742bd66 Jul 22 12:54:55.736868 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.736823 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wt675"] Jul 22 12:54:55.739098 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:55.739071 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede0ebb5_902c_4234_bb64_2fa4e7bac371.slice/crio-7010d54973afb89071d53c063aee024ba7c6ef74994d53860f1838f9793bc2cc WatchSource:0}: Error finding container 7010d54973afb89071d53c063aee024ba7c6ef74994d53860f1838f9793bc2cc: Status 404 returned error can't find the container with id 7010d54973afb89071d53c063aee024ba7c6ef74994d53860f1838f9793bc2cc Jul 22 12:54:55.739826 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.739806 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:55.901497 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.901465 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt675" event={"ID":"ede0ebb5-902c-4234-bb64-2fa4e7bac371","Type":"ContainerStarted","Data":"990c331277145a9dd8da8036ca34619470b95d281007c27df55d4d7d25c2414b"} Jul 22 12:54:55.901684 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.901527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wt675" event={"ID":"ede0ebb5-902c-4234-bb64-2fa4e7bac371","Type":"ContainerStarted","Data":"7010d54973afb89071d53c063aee024ba7c6ef74994d53860f1838f9793bc2cc"} Jul 22 12:54:55.901684 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.901552 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:54:55.902613 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.902590 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hcl6" event={"ID":"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141","Type":"ContainerStarted","Data":"8624aac58454d897211b52b110d94d5204b15a144cc6bae2561449b63742bd66"} Jul 22 12:54:55.919263 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:55.919215 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wt675" podStartSLOduration=65.919200773 podStartE2EDuration="1m5.919200773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:55.918102004 +0000 UTC m=+65.804738670" watchObservedRunningTime="2026-07-22 12:54:55.919200773 +0000 UTC m=+65.805837440" Jul 22 12:54:56.131975 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:56.131875 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:56.190264 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:56.190219 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:56.529076 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:56.529043 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:56.585855 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:56.585823 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.145484 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.145398 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.221598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.221548 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.341527 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.341483 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.403777 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.403695 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.495912 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.495879 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:57.496105 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.495921 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:57.498464 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.498437 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbca4457-c725-4b65-b816-02a9b5938f97-metrics-tls\") pod \"dns-default-bhn78\" (UID: \"cbca4457-c725-4b65-b816-02a9b5938f97\") " pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:57.499115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.499090 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"image-registry-6db86bcdf4-lhr8c\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:57.646048 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.646020 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9xmtd\"" Jul 22 12:54:57.654148 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.654087 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:57.661113 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.661086 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6s9tz\"" Jul 22 12:54:57.669471 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.669449 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhn78" Jul 22 12:54:57.737239 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.737207 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:57.811631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.811601 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:54:57.815326 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:57.815270 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc968cce_c6a0_4b3b_96ca_c30853b8a2f6.slice/crio-9ca6a6a18ff65f72652364cae1733b5b53a2e47e5bc827a0f2dcbd73cab67ccb WatchSource:0}: Error finding container 9ca6a6a18ff65f72652364cae1733b5b53a2e47e5bc827a0f2dcbd73cab67ccb: Status 404 returned error can't find the container with id 9ca6a6a18ff65f72652364cae1733b5b53a2e47e5bc827a0f2dcbd73cab67ccb Jul 22 12:54:57.830743 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.830631 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhn78"] Jul 22 12:54:57.833564 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:54:57.833536 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbca4457_c725_4b65_b816_02a9b5938f97.slice/crio-ab5889904a478185c3e615dcbcaac2871c6b1ede6c58509046ded8c66f6307dd WatchSource:0}: Error finding container ab5889904a478185c3e615dcbcaac2871c6b1ede6c58509046ded8c66f6307dd: Status 404 returned error can't find the container with id ab5889904a478185c3e615dcbcaac2871c6b1ede6c58509046ded8c66f6307dd Jul 22 12:54:57.912754 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.912668 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" event={"ID":"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6","Type":"ContainerStarted","Data":"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34"} Jul 22 12:54:57.912754 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.912733 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" event={"ID":"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6","Type":"ContainerStarted","Data":"9ca6a6a18ff65f72652364cae1733b5b53a2e47e5bc827a0f2dcbd73cab67ccb"} Jul 22 12:54:57.912987 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.912783 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:54:57.914110 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.914077 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhn78" event={"ID":"cbca4457-c725-4b65-b816-02a9b5938f97","Type":"ContainerStarted","Data":"ab5889904a478185c3e615dcbcaac2871c6b1ede6c58509046ded8c66f6307dd"} Jul 22 12:54:57.933065 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.933003 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" podStartSLOduration=66.932982272 podStartE2EDuration="1m6.932982272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:57.932358689 +0000 UTC m=+67.818995366" watchObservedRunningTime="2026-07-22 12:54:57.932982272 +0000 UTC m=+67.819618941" Jul 22 12:54:57.934953 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:57.934930 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:58.137910 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:58.137871 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:58.537186 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:58.537148 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:59.139236 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:59.139187 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:59.331128 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:59.331090 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:59.549708 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:59.549679 2549 scope.go:117] "RemoveContainer" containerID="8c4d38386ba308c8a7378b3b214b57fe474ee0d677c9fa8c8fa544709f44305c" Jul 22 12:54:59.739012 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:59.738972 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:54:59.799289 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:54:59.799248 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:00.333246 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.333210 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:00.742402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.739428 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:00.928359 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.928336 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 12:55:00.928472 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.928409 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-697sl" event={"ID":"4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9","Type":"ContainerStarted","Data":"fad6f97a2a0368aea106c644da4346386444d4202d839e53ccababbfc4a9326b"} Jul 22 12:55:00.929082 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.928974 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:55:00.930608 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.930575 2549 patch_prober.go:28] interesting pod/console-operator-565b7b569d-697sl container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 22 12:55:00.930713 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.930625 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-697sl" podUID="4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 22 12:55:00.947319 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:00.947278 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-697sl" podStartSLOduration=20.372184073 podStartE2EDuration="22.947264025s" totalImagesPullingTime="2.575079952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:00.946000409 +0000 UTC m=+70.832637076" watchObservedRunningTime="2026-07-22 12:55:00.947264025 +0000 UTC m=+70.833900751" Jul 22 12:55:01.140454 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.140393 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:01.408243 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.408207 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:01.511195 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.511154 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:01.854697 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.854668 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:01.933655 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.933617 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hcl6" event={"ID":"ca56356c-b33f-4ca5-b2a9-0bcdd66fc141","Type":"ContainerStarted","Data":"1952e5ccb1eaed2b1acf24ab577dc7a24ffe0fdf5db04f99b708a9adb5e2eff1"} Jul 22 12:55:01.935404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.935379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhn78" event={"ID":"cbca4457-c725-4b65-b816-02a9b5938f97","Type":"ContainerStarted","Data":"a7e8bf0fbed3203422dfb417175a03c3fada731201f97cde2a008c66677fb631"} Jul 22 12:55:01.935569 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.935420 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhn78" event={"ID":"cbca4457-c725-4b65-b816-02a9b5938f97","Type":"ContainerStarted","Data":"7ef35cd0f9f568e4bceb0d324fe9bd443052f7a40e66c3589cc40a8f771e6536"} Jul 22 12:55:01.935705 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.935686 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bhn78" Jul 22 12:55:01.939489 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.939468 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-697sl" Jul 22 12:55:01.950197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.950161 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6hcl6" podStartSLOduration=66.845743292 podStartE2EDuration="1m11.950143369s" totalImagesPullingTime="5.104400077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:01.949208656 +0000 UTC m=+71.835845322" watchObservedRunningTime="2026-07-22 12:55:01.950143369 +0000 UTC m=+71.836780038" Jul 22 12:55:01.954717 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.954695 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:01.966480 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:01.966446 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bhn78" podStartSLOduration=33.97123366 podStartE2EDuration="36.966433253s" totalImagesPullingTime="2.995199593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:01.965804684 +0000 UTC m=+71.852441352" watchObservedRunningTime="2026-07-22 12:55:01.966433253 +0000 UTC m=+71.853069897" Jul 22 12:55:02.102997 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.102961 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.137246 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.137171 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:55:02.137246 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.137220 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:02.137424 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.137395 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:02.137920 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.137900 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545a4991-ecee-4898-b378-9b5d22d2b40e-service-ca-bundle\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:02.139489 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.139471 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d27353-52e1-4e3d-8559-53a0955cdef5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w22gc\" (UID: \"b4d27353-52e1-4e3d-8559-53a0955cdef5\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:55:02.139597 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.139530 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/545a4991-ecee-4898-b378-9b5d22d2b40e-metrics-certs\") pod \"router-default-5d6d8b6fd8-5cgh2\" (UID: \"545a4991-ecee-4898-b378-9b5d22d2b40e\") " pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:02.291020 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.290982 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4j4nx\"" Jul 22 12:55:02.298490 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.298456 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" Jul 22 12:55:02.298635 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.298532 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j42v2\"" Jul 22 12:55:02.306603 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.306579 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:02.372291 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.372104 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.436598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.436540 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc"] Jul 22 12:55:02.439149 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:02.439124 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d27353_52e1_4e3d_8559_53a0955cdef5.slice/crio-5169b753b6edac505d105d6a44b4fbf9409e3716d2f46a959a8795440e615bfd WatchSource:0}: Error finding container 5169b753b6edac505d105d6a44b4fbf9409e3716d2f46a959a8795440e615bfd: Status 404 returned error can't find the container with id 5169b753b6edac505d105d6a44b4fbf9409e3716d2f46a959a8795440e615bfd Jul 22 12:55:02.460025 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.460006 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d6d8b6fd8-5cgh2"] Jul 22 12:55:02.462616 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:02.462587 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545a4991_ecee_4898_b378_9b5d22d2b40e.slice/crio-0e2bbbc10ff66656635e437aa4042e0cb760971c892377d05f391e2e058b1375 WatchSource:0}: Error finding container 0e2bbbc10ff66656635e437aa4042e0cb760971c892377d05f391e2e058b1375: Status 404 returned error can't find the container with id 0e2bbbc10ff66656635e437aa4042e0cb760971c892377d05f391e2e058b1375 Jul 22 12:55:02.529684 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.529659 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.632830 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.632800 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.733055 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.732968 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.933633 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.933601 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:02.939786 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.939755 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" event={"ID":"b4d27353-52e1-4e3d-8559-53a0955cdef5","Type":"ContainerStarted","Data":"5169b753b6edac505d105d6a44b4fbf9409e3716d2f46a959a8795440e615bfd"} Jul 22 12:55:02.941078 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.941054 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" event={"ID":"545a4991-ecee-4898-b378-9b5d22d2b40e","Type":"ContainerStarted","Data":"412359b8877fed8849df25829a4328228b2a6a6ec768e59a48e9269eab29cbd9"} Jul 22 12:55:02.941196 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.941098 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" event={"ID":"545a4991-ecee-4898-b378-9b5d22d2b40e","Type":"ContainerStarted","Data":"0e2bbbc10ff66656635e437aa4042e0cb760971c892377d05f391e2e058b1375"} Jul 22 12:55:02.962453 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:02.962412 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" podStartSLOduration=32.962400489 podStartE2EDuration="32.962400489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:02.961175692 +0000 UTC m=+72.847812363" watchObservedRunningTime="2026-07-22 12:55:02.962400489 +0000 UTC m=+72.849037159" Jul 22 12:55:03.122208 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.122172 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:03.200172 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.200120 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:03.307317 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.307289 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:03.310330 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.310303 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:03.511185 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.511151 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:03.884259 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.884174 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:03.945947 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.945915 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:03.946957 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:03.946935 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d6d8b6fd8-5cgh2" Jul 22 12:55:04.536608 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.536564 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:04.686197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.686155 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:04.794683 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.794658 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:04.933631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.933599 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:04.950563 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.950532 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" event={"ID":"b4d27353-52e1-4e3d-8559-53a0955cdef5","Type":"ContainerStarted","Data":"b7357d7bc6ab696dc4b620a417322127c2a056346c6654bae659c2a2070c47a1"} Jul 22 12:55:04.967063 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:04.967020 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w22gc" podStartSLOduration=32.969050792 podStartE2EDuration="34.967005409s" totalImagesPullingTime="1.997954617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:04.966635267 +0000 UTC m=+74.853271935" watchObservedRunningTime="2026-07-22 12:55:04.967005409 +0000 UTC m=+74.853642075" Jul 22 12:55:05.151005 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:05.150903 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:06.679532 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:06.679489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:55:06.681836 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:06.681815 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f4596c3-c593-42b8-b3a8-ddb750bd97db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rt8gp\" (UID: \"0f4596c3-c593-42b8-b3a8-ddb750bd97db\") " pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:55:06.923507 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:06.923472 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dxxk2\"" Jul 22 12:55:06.931572 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:06.931528 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rt8gp" Jul 22 12:55:07.057061 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:07.057032 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rt8gp"] Jul 22 12:55:07.060276 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:07.060250 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4596c3_c593_42b8_b3a8_ddb750bd97db.slice/crio-ec0ed908f78364518b94e704e38b740c071baf36207ec398646332ffac99037d WatchSource:0}: Error finding container ec0ed908f78364518b94e704e38b740c071baf36207ec398646332ffac99037d: Status 404 returned error can't find the container with id ec0ed908f78364518b94e704e38b740c071baf36207ec398646332ffac99037d Jul 22 12:55:07.963791 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:07.963752 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rt8gp" event={"ID":"0f4596c3-c593-42b8-b3a8-ddb750bd97db","Type":"ContainerStarted","Data":"ec0ed908f78364518b94e704e38b740c071baf36207ec398646332ffac99037d"} Jul 22 12:55:07.988827 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:07.988787 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:55:07.991778 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:07.991750 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e742-2404-4bb2-8f4a-8f4f876493cd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6rgq7\" (UID: \"c4d3e742-2404-4bb2-8f4a-8f4f876493cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:55:08.004621 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:08.004592 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5ctvz\"" Jul 22 12:55:08.012107 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:08.012057 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" Jul 22 12:55:08.156595 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:08.156543 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7"] Jul 22 12:55:08.971285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:08.971247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" event={"ID":"c4d3e742-2404-4bb2-8f4a-8f4f876493cd","Type":"ContainerStarted","Data":"42ed1fc45ae61c5a17ec166eae6f5d07f63eff7708d6484d6fcf8ef7618ddb86"} Jul 22 12:55:09.565655 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:09.565620 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:09.683537 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:09.683449 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:09.770718 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:09.770680 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:09.871098 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:09.871058 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:10.542568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:10.542498 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:10.604179 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:10.604136 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:11.737201 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.737164 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:55:11.743629 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.743607 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.747693 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747659 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 12:55:11.747840 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747745 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cb2bb\"" Jul 22 12:55:11.747840 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747786 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 12:55:11.747840 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747656 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 12:55:11.747982 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747926 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 12:55:11.748025 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.747998 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 12:55:11.748077 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.748046 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 12:55:11.748125 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.748086 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 12:55:11.750384 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.750364 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:55:11.928583 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928546 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.928763 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928592 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.928763 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928629 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.928763 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928692 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.928763 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928753 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjf9\" (UniqueName: \"kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:11.928938 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:11.928783 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030207 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030391 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030228 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjf9\" (UniqueName: \"kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030391 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030391 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030329 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030391 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030362 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.030654 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.030401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.031122 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.031099 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.031232 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.031099 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.031232 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.031214 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.033502 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.033476 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.033609 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.033528 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.040327 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.039821 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjf9\" (UniqueName: \"kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9\") pod \"console-69dfc96764-z4crz\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.055501 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.055484 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:12.639229 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.638888 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:55:12.642344 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:12.642314 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf00360_cc38_43c2_a2ca_b8eb0a681bc0.slice/crio-e13e4f98a866c6867f9162303bff37db344448c8e7a446d2598ff477afbeb380 WatchSource:0}: Error finding container e13e4f98a866c6867f9162303bff37db344448c8e7a446d2598ff477afbeb380: Status 404 returned error can't find the container with id e13e4f98a866c6867f9162303bff37db344448c8e7a446d2598ff477afbeb380 Jul 22 12:55:12.938827 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.938797 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:12.948411 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.948390 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bhn78" Jul 22 12:55:12.991872 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.991831 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dfc96764-z4crz" event={"ID":"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0","Type":"ContainerStarted","Data":"e13e4f98a866c6867f9162303bff37db344448c8e7a446d2598ff477afbeb380"} Jul 22 12:55:12.994717 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.994688 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rt8gp" event={"ID":"0f4596c3-c593-42b8-b3a8-ddb750bd97db","Type":"ContainerStarted","Data":"760a8b71f6ad0536bc3986b94c08a87236c23da6fb48b8492cca7301b4f00551"} Jul 22 12:55:12.997591 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.997284 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" event={"ID":"c4d3e742-2404-4bb2-8f4a-8f4f876493cd","Type":"ContainerStarted","Data":"3838f6c6a32e72c57106e9aca5dc72b3c7b5531b414e92a29f177e8b9220c6b7"} Jul 22 12:55:12.997591 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:12.997326 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" event={"ID":"c4d3e742-2404-4bb2-8f4a-8f4f876493cd","Type":"ContainerStarted","Data":"9e07b229b8a3012478b44f3423f439b990de22e52a66796bea44dbb90021c3cf"} Jul 22 12:55:13.015269 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:13.015218 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6rgq7" podStartSLOduration=32.710551888 podStartE2EDuration="37.015200397s" totalImagesPullingTime="4.304648509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:13.013750035 +0000 UTC m=+82.900386704" watchObservedRunningTime="2026-07-22 12:55:13.015200397 +0000 UTC m=+82.901837067" Jul 22 12:55:13.020680 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:13.020632 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:14.125776 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:14.125742 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:14.197238 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:14.197200 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:14.975681 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:14.975593 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:15.055696 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:15.055615 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:15.368066 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:15.368034 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:15.925262 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:15.925220 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:16.056954 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:16.056919 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:17.521591 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.521558 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:17.622394 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.622359 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:17.659249 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.659221 2549 patch_prober.go:28] interesting pod/image-registry-6db86bcdf4-lhr8c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 12:55:17.659402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.659270 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 12:55:17.722292 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.722260 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:17.935807 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.935728 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:17.989839 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:17.989802 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:18.018721 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.018686 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rt8gp" event={"ID":"0f4596c3-c593-42b8-b3a8-ddb750bd97db","Type":"ContainerStarted","Data":"6a46152dd8e73d72797e0b50d830b9ddf4decfb26aec150e0d44b86af990d377"} Jul 22 12:55:18.020141 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.020116 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dfc96764-z4crz" event={"ID":"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0","Type":"ContainerStarted","Data":"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237"} Jul 22 12:55:18.040702 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.040650 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69dfc96764-z4crz" podStartSLOduration=2.5335763780000002 podStartE2EDuration="7.040636423s" totalImagesPullingTime="4.507060045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:18.040105462 +0000 UTC m=+87.926742128" watchObservedRunningTime="2026-07-22 12:55:18.040636423 +0000 UTC m=+87.927273090" Jul 22 12:55:18.238159 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.238060 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:18.337528 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.337472 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:18.488586 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.488482 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:18.922855 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:18.922824 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:55:19.199974 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:19.199893 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:19.299753 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:19.299719 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.129336 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.129304 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.425185 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.425093 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x"] Jul 22 12:55:20.439258 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.439213 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jwhv5"] Jul 22 12:55:20.439424 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.439344 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.442162 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.442138 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 12:55:20.442397 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.442378 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 12:55:20.442490 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.442381 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 12:55:20.443217 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.443198 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m25dc\"" Jul 22 12:55:20.445088 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.445068 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x"] Jul 22 12:55:20.445206 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.445186 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.447580 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.447558 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 12:55:20.447690 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.447653 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 12:55:20.447850 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.447833 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 12:55:20.461952 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.461932 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8hfc\"" Jul 22 12:55:20.500434 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500405 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500465 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500493 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500533 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500563 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-699m9\" (UniqueName: \"kubernetes.io/projected/6fe5233b-fd63-45d7-a7a6-aae64edfd883-kube-api-access-699m9\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500588 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcspn\" (UniqueName: \"kubernetes.io/projected/bea5bbfb-6150-48cf-977a-a3d5807334ee-kube-api-access-bcspn\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-sys\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.500631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-wtmp\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.501058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-textfile\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.501058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500739 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.501058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500763 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fe5233b-fd63-45d7-a7a6-aae64edfd883-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.501058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500783 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-root\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.501058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.500799 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-metrics-client-ca\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.505714 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.505678 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.601651 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601622 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcspn\" (UniqueName: \"kubernetes.io/projected/bea5bbfb-6150-48cf-977a-a3d5807334ee-kube-api-access-bcspn\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-sys\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601686 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-wtmp\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601714 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-textfile\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601760 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601784 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fe5233b-fd63-45d7-a7a6-aae64edfd883-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601809 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-root\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.601841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601830 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-metrics-client-ca\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601863 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-wtmp\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601878 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-root\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601927 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea5bbfb-6150-48cf-977a-a3d5807334ee-sys\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.601984 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.602012 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.602044 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-textfile\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.602060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:20.602128 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 12:55:20.602192 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:20.602183 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls podName:bea5bbfb-6150-48cf-977a-a3d5807334ee nodeName:}" failed. No retries permitted until 2026-07-22 12:55:21.10216281 +0000 UTC m=+90.988799462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls") pod "node-exporter-jwhv5" (UID: "bea5bbfb-6150-48cf-977a-a3d5807334ee") : secret "node-exporter-tls" not found Jul 22 12:55:20.602719 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:20.602216 2549 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 22 12:55:20.603459 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:20.603205 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls podName:6fe5233b-fd63-45d7-a7a6-aae64edfd883 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:21.103179145 +0000 UTC m=+90.989815803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-25v5x" (UID: "6fe5233b-fd63-45d7-a7a6-aae64edfd883") : secret "openshift-state-metrics-tls" not found Jul 22 12:55:20.603606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.603532 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fe5233b-fd63-45d7-a7a6-aae64edfd883-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.603606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.602126 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-699m9\" (UniqueName: \"kubernetes.io/projected/6fe5233b-fd63-45d7-a7a6-aae64edfd883-kube-api-access-699m9\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.603760 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.603662 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-metrics-client-ca\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.605314 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.604728 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.605314 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.604807 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.605314 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.604864 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.609510 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.609480 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.614423 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.614397 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcspn\" (UniqueName: \"kubernetes.io/projected/bea5bbfb-6150-48cf-977a-a3d5807334ee-kube-api-access-bcspn\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:20.615866 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.615840 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-699m9\" (UniqueName: \"kubernetes.io/projected/6fe5233b-fd63-45d7-a7a6-aae64edfd883-kube-api-access-699m9\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:20.712446 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.712371 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.806460 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.806425 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:20.909662 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:20.909628 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:21.109389 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.109353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:21.109613 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.109413 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:21.112189 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.112165 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fe5233b-fd63-45d7-a7a6-aae64edfd883-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-25v5x\" (UID: \"6fe5233b-fd63-45d7-a7a6-aae64edfd883\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:21.112313 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.112230 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bea5bbfb-6150-48cf-977a-a3d5807334ee-node-exporter-tls\") pod \"node-exporter-jwhv5\" (UID: \"bea5bbfb-6150-48cf-977a-a3d5807334ee\") " pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:21.282283 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.282251 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:21.352366 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.352339 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" Jul 22 12:55:21.359559 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.359488 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jwhv5" Jul 22 12:55:21.382822 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.382791 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:21.449299 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:21.449269 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea5bbfb_6150_48cf_977a_a3d5807334ee.slice/crio-3803b57de8259bbc0db0ae6c97d6cee22a6d4efdc12027c3a9bc6dbde649d053 WatchSource:0}: Error finding container 3803b57de8259bbc0db0ae6c97d6cee22a6d4efdc12027c3a9bc6dbde649d053: Status 404 returned error can't find the container with id 3803b57de8259bbc0db0ae6c97d6cee22a6d4efdc12027c3a9bc6dbde649d053 Jul 22 12:55:21.481260 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.481229 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:55:21.485567 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.485510 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:21.498507 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.497399 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.499321 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.499295 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:55:21.505541 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.505502 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 12:55:21.505652 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.505551 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7mzxp\"" Jul 22 12:55:21.509139 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.509116 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 12:55:21.509463 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.509446 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 12:55:21.510634 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.510548 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 12:55:21.510842 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.510826 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 12:55:21.510937 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.510921 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 12:55:21.511057 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.511038 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 12:55:21.511057 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.510830 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 12:55:21.511537 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.511365 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 12:55:21.513420 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513381 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513554 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513429 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513554 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513554 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513536 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513563 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513595 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513686 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513745 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513722 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513766 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513826 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.513980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.513854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pdfw\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.585815 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.585662 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x"] Jul 22 12:55:21.588441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.588414 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:21.588594 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:21.588466 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe5233b_fd63_45d7_a7a6_aae64edfd883.slice/crio-2618e88760ecd3d6aa464c8aeacc3e5b77bdfd7e30eb0992cf5ee8a9535b971a WatchSource:0}: Error finding container 2618e88760ecd3d6aa464c8aeacc3e5b77bdfd7e30eb0992cf5ee8a9535b971a: Status 404 returned error can't find the container with id 2618e88760ecd3d6aa464c8aeacc3e5b77bdfd7e30eb0992cf5ee8a9535b971a Jul 22 12:55:21.614558 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.614491 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.614678 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.614569 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615135 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615034 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615135 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615135 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615115 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615156 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615188 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pdfw\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615216 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615310 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615273 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615557 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615557 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615355 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.615557 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.615398 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.616645 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:21.615765 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle podName:c2d8024f-1a61-4e11-9a2f-3caa4cc361f0 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:22.115745436 +0000 UTC m=+92.002382083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0") : configmap references non-existent config key: ca-bundle.crt Jul 22 12:55:21.616645 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.616183 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.616645 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.616185 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.617752 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:21.616789 2549 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 22 12:55:21.617752 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:21.616846 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls podName:c2d8024f-1a61-4e11-9a2f-3caa4cc361f0 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:22.116831023 +0000 UTC m=+92.003467668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0") : secret "alertmanager-main-tls" not found Jul 22 12:55:21.617752 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.617528 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.618585 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.618560 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.619078 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.619058 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.619440 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.619393 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.619851 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.619828 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.620789 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.620745 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.620872 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.620846 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.621130 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.621109 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.628209 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.628183 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pdfw\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:21.910912 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:21.910822 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:22.039272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.039232 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rt8gp" event={"ID":"0f4596c3-c593-42b8-b3a8-ddb750bd97db","Type":"ContainerStarted","Data":"6045c8769dfb8d77bff321ab0d772e2f9b820b78ab87db7e4fa271336505ac5a"} Jul 22 12:55:22.040886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.040845 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhv5" event={"ID":"bea5bbfb-6150-48cf-977a-a3d5807334ee","Type":"ContainerStarted","Data":"3803b57de8259bbc0db0ae6c97d6cee22a6d4efdc12027c3a9bc6dbde649d053"} Jul 22 12:55:22.043077 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.043051 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" event={"ID":"6fe5233b-fd63-45d7-a7a6-aae64edfd883","Type":"ContainerStarted","Data":"09f40dabd5b699e85499b63847309edceb5a7e99d3b74d2cf90a795739b94386"} Jul 22 12:55:22.043176 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.043110 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" event={"ID":"6fe5233b-fd63-45d7-a7a6-aae64edfd883","Type":"ContainerStarted","Data":"041b29a6e894967ab335a5a5922fe849af50c3c6ecb71024fd94de08d75b19a0"} Jul 22 12:55:22.043176 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.043141 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" event={"ID":"6fe5233b-fd63-45d7-a7a6-aae64edfd883","Type":"ContainerStarted","Data":"2618e88760ecd3d6aa464c8aeacc3e5b77bdfd7e30eb0992cf5ee8a9535b971a"} Jul 22 12:55:22.055972 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.055943 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:22.056096 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.056009 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:22.060256 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.060206 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rt8gp" podStartSLOduration=33.585554155 podStartE2EDuration="48.060186077s" totalImagesPullingTime="14.474631922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:22.058980018 +0000 UTC m=+91.945616686" watchObservedRunningTime="2026-07-22 12:55:22.060186077 +0000 UTC m=+91.946822744" Jul 22 12:55:22.061744 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.061725 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:22.121339 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.120764 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:22.121339 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.120905 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:22.122109 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.122082 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:22.123568 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.123550 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:22.417494 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.417473 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:55:22.562253 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:22.562231 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:55:22.612450 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:22.612405 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d8024f_1a61_4e11_9a2f_3caa4cc361f0.slice/crio-a69a7ae602634d6d8a59fbc6f60408422f5c8514fba6b1bd679a4f34ecb5725b WatchSource:0}: Error finding container a69a7ae602634d6d8a59fbc6f60408422f5c8514fba6b1bd679a4f34ecb5725b: Status 404 returned error can't find the container with id a69a7ae602634d6d8a59fbc6f60408422f5c8514fba6b1bd679a4f34ecb5725b Jul 22 12:55:23.050391 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.050358 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"a69a7ae602634d6d8a59fbc6f60408422f5c8514fba6b1bd679a4f34ecb5725b"} Jul 22 12:55:23.052038 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.052009 2549 generic.go:356] "Generic (PLEG): container finished" podID="bea5bbfb-6150-48cf-977a-a3d5807334ee" containerID="3eba019c2c4e50be456e9038aa53c027da9aaa4da653a699f75e335e6345f494" exitCode=0 Jul 22 12:55:23.052179 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.052097 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhv5" event={"ID":"bea5bbfb-6150-48cf-977a-a3d5807334ee","Type":"ContainerDied","Data":"3eba019c2c4e50be456e9038aa53c027da9aaa4da653a699f75e335e6345f494"} Jul 22 12:55:23.056596 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.056574 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:55:23.366756 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.366674 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:23.463848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.463818 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:23.633333 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.633249 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:23.733799 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:23.733767 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:24.058361 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.058323 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" event={"ID":"6fe5233b-fd63-45d7-a7a6-aae64edfd883","Type":"ContainerStarted","Data":"d1cf88c0d22bf87f2b26fc4313bdd7627d43056276dc91495eef74329df238d5"} Jul 22 12:55:24.060611 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.060586 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhv5" event={"ID":"bea5bbfb-6150-48cf-977a-a3d5807334ee","Type":"ContainerStarted","Data":"758bb3f37295269b0c2d255488fb9ca11f35db79aa2d386c337828353b093507"} Jul 22 12:55:24.060748 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.060626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jwhv5" event={"ID":"bea5bbfb-6150-48cf-977a-a3d5807334ee","Type":"ContainerStarted","Data":"fe3bddf0eaf45caac1503de4a2e91c0a3ebebd5e8fdc63cc8c475ceb78e3c5c4"} Jul 22 12:55:24.081532 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.081470 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-25v5x" podStartSLOduration=2.800735868 podStartE2EDuration="4.081455226s" totalImagesPullingTime="1.280719358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:24.079880469 +0000 UTC m=+93.966517136" watchObservedRunningTime="2026-07-22 12:55:24.081455226 +0000 UTC m=+93.968091892" Jul 22 12:55:24.101793 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.101746 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jwhv5" podStartSLOduration=3.069455845 podStartE2EDuration="4.101730836s" totalImagesPullingTime="966.18267ms" totalInitContainerRuntime="66.092321ms" isStatefulPod=true podCreationTimestamp="2026-07-22 12:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:24.101678431 +0000 UTC m=+93.988315110" watchObservedRunningTime="2026-07-22 12:55:24.101730836 +0000 UTC m=+93.988367503" Jul 22 12:55:24.739793 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.739722 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77c44d85b4-tvqkn"] Jul 22 12:55:24.742880 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.742861 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.746784 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.746754 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 12:55:24.746915 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.746754 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 12:55:24.746915 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.746755 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 12:55:24.746915 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.746756 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rcmwb\"" Jul 22 12:55:24.746915 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.746804 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 12:55:24.747311 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.747041 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3tk6eiuams4nn\"" Jul 22 12:55:24.751966 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.751946 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77c44d85b4-tvqkn"] Jul 22 12:55:24.846094 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846061 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrmxk\" (UniqueName: \"kubernetes.io/projected/8553a000-ed49-4db2-aebf-54cf68773390-kube-api-access-qrmxk\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846112 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-metrics-server-audit-profiles\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846143 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-client-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846192 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846285 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846260 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-client-certs\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846440 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846326 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8553a000-ed49-4db2-aebf-54cf68773390-audit-log\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.846440 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.846360 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-tls\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.946757 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.946725 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-client-certs\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.946914 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.946768 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8553a000-ed49-4db2-aebf-54cf68773390-audit-log\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.946914 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.946795 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-tls\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.946914 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.946841 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrmxk\" (UniqueName: \"kubernetes.io/projected/8553a000-ed49-4db2-aebf-54cf68773390-kube-api-access-qrmxk\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.947076 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.947043 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-metrics-server-audit-profiles\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.947122 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.947077 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-client-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.947122 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.947111 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.947291 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.947266 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8553a000-ed49-4db2-aebf-54cf68773390-audit-log\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.947876 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.947856 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.948095 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.948075 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8553a000-ed49-4db2-aebf-54cf68773390-metrics-server-audit-profiles\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.949701 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.949678 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-client-ca-bundle\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.949848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.949832 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-client-certs\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.949892 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.949834 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8553a000-ed49-4db2-aebf-54cf68773390-secret-metrics-server-tls\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.959997 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.959977 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrmxk\" (UniqueName: \"kubernetes.io/projected/8553a000-ed49-4db2-aebf-54cf68773390-kube-api-access-qrmxk\") pod \"metrics-server-77c44d85b4-tvqkn\" (UID: \"8553a000-ed49-4db2-aebf-54cf68773390\") " pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:24.996601 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:24.996533 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:25.052722 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.052691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:25.065966 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.065935 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22" exitCode=0 Jul 22 12:55:25.066068 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.066017 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22"} Jul 22 12:55:25.096307 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.096270 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:25.210496 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.210459 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77c44d85b4-tvqkn"] Jul 22 12:55:25.213205 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:25.213177 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8553a000_ed49_4db2_aebf_54cf68773390.slice/crio-019eebb5e134284bcdb28ee272680d5843f4442b8384d0add545a144807f8920 WatchSource:0}: Error finding container 019eebb5e134284bcdb28ee272680d5843f4442b8384d0add545a144807f8920: Status 404 returned error can't find the container with id 019eebb5e134284bcdb28ee272680d5843f4442b8384d0add545a144807f8920 Jul 22 12:55:25.771727 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.771693 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:25.838115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:25.838078 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:26.072452 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:26.072356 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" event={"ID":"8553a000-ed49-4db2-aebf-54cf68773390","Type":"ContainerStarted","Data":"019eebb5e134284bcdb28ee272680d5843f4442b8384d0add545a144807f8920"} Jul 22 12:55:26.845711 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:26.845667 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:26.911678 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:26.911649 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wt675" Jul 22 12:55:26.945626 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:26.945566 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:27.079497 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:27.079432 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e"} Jul 22 12:55:27.081883 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:27.081855 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" event={"ID":"8553a000-ed49-4db2-aebf-54cf68773390","Type":"ContainerStarted","Data":"3829370e9e655a6c28bdacd7cb54a6aefc32bd9ae655755afb6061a1534aedf0"} Jul 22 12:55:27.101973 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:27.101896 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" podStartSLOduration=1.326924784 podStartE2EDuration="3.101879671s" totalImagesPullingTime="1.774954887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:27.100386124 +0000 UTC m=+96.987022803" watchObservedRunningTime="2026-07-22 12:55:27.101879671 +0000 UTC m=+96.988516413" Jul 22 12:55:28.089317 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.089288 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9"} Jul 22 12:55:28.089627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.089380 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b"} Jul 22 12:55:28.089627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.089410 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1"} Jul 22 12:55:28.089627 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.089434 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21"} Jul 22 12:55:28.774271 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.774185 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:55:28.777502 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.777486 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.785798 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.785773 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 12:55:28.795525 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.795485 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:55:28.887279 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887242 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887296 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887319 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887545 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887489 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887585 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887543 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.887585 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.887577 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7fhj\" (UniqueName: \"kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988163 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988131 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988163 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988168 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988370 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988423 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988392 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988471 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988446 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7fhj\" (UniqueName: \"kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988570 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988475 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988570 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988565 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.988981 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.988956 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.989115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.989082 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.989188 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.989140 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.989419 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.989398 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.991025 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.990996 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.991025 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.991012 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:28.997993 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:28.997929 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7fhj\" (UniqueName: \"kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj\") pod \"console-6ffb8b669c-d7bgn\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:29.087474 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:29.087391 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:29.096583 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:29.096554 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerStarted","Data":"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851"} Jul 22 12:55:29.125230 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:29.124201 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.736710729 podStartE2EDuration="8.124177362s" totalImagesPullingTime="4.372602054s" totalInitContainerRuntime="14.864579ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:29.121236131 +0000 UTC m=+99.007872795" watchObservedRunningTime="2026-07-22 12:55:29.124177362 +0000 UTC m=+99.010814029" Jul 22 12:55:29.226930 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:29.226904 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:55:29.228728 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:29.228701 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6b354c_36e7_4783_981b_9ce565ae628f.slice/crio-1b8ee002a8ffb5b92528f8379c32c7c43d003c2d1ca80237ed3a3130c085498d WatchSource:0}: Error finding container 1b8ee002a8ffb5b92528f8379c32c7c43d003c2d1ca80237ed3a3130c085498d: Status 404 returned error can't find the container with id 1b8ee002a8ffb5b92528f8379c32c7c43d003c2d1ca80237ed3a3130c085498d Jul 22 12:55:30.102912 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:30.102877 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb8b669c-d7bgn" event={"ID":"df6b354c-36e7-4783-981b-9ce565ae628f","Type":"ContainerStarted","Data":"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad"} Jul 22 12:55:30.103320 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:30.102938 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb8b669c-d7bgn" event={"ID":"df6b354c-36e7-4783-981b-9ce565ae628f","Type":"ContainerStarted","Data":"1b8ee002a8ffb5b92528f8379c32c7c43d003c2d1ca80237ed3a3130c085498d"} Jul 22 12:55:30.123045 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:30.122996 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ffb8b669c-d7bgn" podStartSLOduration=2.12298082 podStartE2EDuration="2.12298082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:30.121740101 +0000 UTC m=+100.008376768" watchObservedRunningTime="2026-07-22 12:55:30.12298082 +0000 UTC m=+100.009617569" Jul 22 12:55:30.497911 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:30.497836 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:31.102778 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:31.102738 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:31.424482 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:31.424390 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:55:31.503114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:31.503080 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:31.608245 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:31.608211 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:32.196631 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:32.196599 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:32.261493 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:32.261457 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:33.127938 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:33.127904 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:33.229447 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:33.229408 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:39.087756 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.087724 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:39.088128 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.087785 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:39.092828 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.092806 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:39.146506 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.146484 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:55:39.198832 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.198798 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:55:39.291299 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.291270 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:39.392503 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.392422 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:39.493245 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:39.493217 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:42.342262 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:42.342227 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:42.400573 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:42.400543 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:45.053176 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:45.053137 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:45.053598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:45.053200 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:55:48.931803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:48.931763 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:49.032970 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:49.032933 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:49.097035 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:49.096946 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:49.181325 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:49.181294 2549 generic.go:356] "Generic (PLEG): container finished" podID="05fd62ec-ad1e-4655-b4ce-0ee0c544c086" containerID="b64b0f49f5106502ff47ce435c161ebac68aa1dd85dcbad1c030968d0996d526" exitCode=0 Jul 22 12:55:49.181483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:49.181343 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7j42r" event={"ID":"05fd62ec-ad1e-4655-b4ce-0ee0c544c086","Type":"ContainerDied","Data":"b64b0f49f5106502ff47ce435c161ebac68aa1dd85dcbad1c030968d0996d526"} Jul 22 12:55:49.181696 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:49.181682 2549 scope.go:117] "RemoveContainer" containerID="b64b0f49f5106502ff47ce435c161ebac68aa1dd85dcbad1c030968d0996d526" Jul 22 12:55:50.187250 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:50.187207 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-7j42r" event={"ID":"05fd62ec-ad1e-4655-b4ce-0ee0c544c086","Type":"ContainerStarted","Data":"848c236315ade6f52f379a1f204835deed888ceff9c9050c0afe3165af84ca94"} Jul 22 12:55:50.188907 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:50.188880 2549 generic.go:356] "Generic (PLEG): container finished" podID="97119692-c8f1-4c97-ad24-b60a46dde183" containerID="45f12195904e054c871dda19aa5e0630aae9d6089164d392af834d5f3c29c102" exitCode=0 Jul 22 12:55:50.189036 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:50.188940 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" event={"ID":"97119692-c8f1-4c97-ad24-b60a46dde183","Type":"ContainerDied","Data":"45f12195904e054c871dda19aa5e0630aae9d6089164d392af834d5f3c29c102"} Jul 22 12:55:50.189257 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:50.189241 2549 scope.go:117] "RemoveContainer" containerID="45f12195904e054c871dda19aa5e0630aae9d6089164d392af834d5f3c29c102" Jul 22 12:55:51.195151 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:51.195112 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9t98t" event={"ID":"97119692-c8f1-4c97-ad24-b60a46dde183","Type":"ContainerStarted","Data":"8fea8c30a6a5172da534de8b7e9bccd1b09db280899aa605c962db2d0c7c997b"} Jul 22 12:55:54.337525 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:54.337485 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:54.454308 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:54.454261 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:56.453340 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.453302 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerName="registry" containerID="cri-o://e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34" gracePeriod=30 Jul 22 12:55:56.695168 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.695146 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:55:56.738121 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738047 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738121 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738085 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pszkd\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738121 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738105 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738369 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738134 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738369 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738179 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738369 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738206 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738369 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738242 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738369 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738292 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") pod \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\" (UID: \"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6\") " Jul 22 12:55:56.738637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738541 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:55:56.738993 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.738961 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:55:56.740846 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.740806 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:55:56.741024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.740995 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:55:56.741133 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.741110 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd" (OuterVolumeSpecName: "kube-api-access-pszkd") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "kube-api-access-pszkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:55:56.741133 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.741124 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:55:56.741233 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.741174 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:55:56.746942 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.746914 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" (UID: "dc968cce-c6a0-4b3b-96ca-c30853b8a2f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:55:56.839564 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839494 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-tls\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839564 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839562 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-trusted-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839564 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839573 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pszkd\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-kube-api-access-pszkd\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839564 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839583 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-installation-pull-secrets\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839592 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-ca-trust-extracted\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839601 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-registry-certificates\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839611 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-image-registry-private-configuration\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:56.839821 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:56.839621 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6-bound-sa-token\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:55:57.218043 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.217991 2549 generic.go:356] "Generic (PLEG): container finished" podID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerID="e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34" exitCode=0 Jul 22 12:55:57.218043 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.218035 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" Jul 22 12:55:57.218244 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.218082 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" event={"ID":"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6","Type":"ContainerDied","Data":"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34"} Jul 22 12:55:57.218244 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.218162 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db86bcdf4-lhr8c" event={"ID":"dc968cce-c6a0-4b3b-96ca-c30853b8a2f6","Type":"ContainerDied","Data":"9ca6a6a18ff65f72652364cae1733b5b53a2e47e5bc827a0f2dcbd73cab67ccb"} Jul 22 12:55:57.218244 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.218183 2549 scope.go:117] "RemoveContainer" containerID="e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34" Jul 22 12:55:57.227000 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.226983 2549 scope.go:117] "RemoveContainer" containerID="e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34" Jul 22 12:55:57.227267 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:55:57.227243 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34\": container with ID starting with e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34 not found: ID does not exist" containerID="e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34" Jul 22 12:55:57.227376 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.227269 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34"} err="failed to get container status \"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34\": rpc error: code = NotFound desc = could not find container \"e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34\": container with ID starting with e3125724c4a6c1e915274260627474635264ec002eac64c3b23b4bd2b2521f34 not found: ID does not exist" Jul 22 12:55:57.242110 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.242088 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:55:57.247596 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.247573 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db86bcdf4-lhr8c"] Jul 22 12:55:57.348588 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.348553 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:57.432408 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:57.432377 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:55:58.553797 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:58.553765 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" path="/var/lib/kubelet/pods/dc968cce-c6a0-4b3b-96ca-c30853b8a2f6/volumes" Jul 22 12:55:59.359938 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:59.359907 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:55:59.362153 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:59.362125 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e009cf55-84ed-4825-ab2b-6a218a079da4-metrics-certs\") pod \"network-metrics-daemon-rht2n\" (UID: \"e009cf55-84ed-4825-ab2b-6a218a079da4\") " pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:55:59.563857 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:59.563827 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsqrc\"" Jul 22 12:55:59.571062 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:59.571040 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rht2n" Jul 22 12:55:59.700044 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:55:59.700015 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rht2n"] Jul 22 12:55:59.703125 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:55:59.703101 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode009cf55_84ed_4825_ab2b_6a218a079da4.slice/crio-f183a31a7f332db83e69fe097039789779bc5357f594ee86491d460347ae796a WatchSource:0}: Error finding container f183a31a7f332db83e69fe097039789779bc5357f594ee86491d460347ae796a: Status 404 returned error can't find the container with id f183a31a7f332db83e69fe097039789779bc5357f594ee86491d460347ae796a Jul 22 12:56:00.231466 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:00.231433 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rht2n" event={"ID":"e009cf55-84ed-4825-ab2b-6a218a079da4","Type":"ContainerStarted","Data":"f183a31a7f332db83e69fe097039789779bc5357f594ee86491d460347ae796a"} Jul 22 12:56:01.238048 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:01.237974 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rht2n" event={"ID":"e009cf55-84ed-4825-ab2b-6a218a079da4","Type":"ContainerStarted","Data":"76717c2b6abb58fe78cf5cf729613485ed577bf5c0a15f9cfd0270ff6aa54e61"} Jul 22 12:56:02.244269 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:02.244240 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rht2n" event={"ID":"e009cf55-84ed-4825-ab2b-6a218a079da4","Type":"ContainerStarted","Data":"e718938355cf7460f3eb790b916493f910999d115d19df9d3fda0c56b130a716"} Jul 22 12:56:02.272701 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:02.270986 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rht2n" podStartSLOduration=130.880044776 podStartE2EDuration="2m12.270966026s" totalImagesPullingTime="1.39092125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:56:02.269585016 +0000 UTC m=+132.156221687" watchObservedRunningTime="2026-07-22 12:56:02.270966026 +0000 UTC m=+132.157602695" Jul 22 12:56:02.376299 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:02.376261 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:02.437770 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:02.437732 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:04.221100 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.221055 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69dfc96764-z4crz" podUID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" containerName="console" containerID="cri-o://843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237" gracePeriod=15 Jul 22 12:56:04.473892 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.473839 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:56:04.500697 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.500665 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.500846 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.500755 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.500846 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.500798 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.500846 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.500824 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.501124 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501103 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.501207 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501172 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:56:04.501207 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501195 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfjf9\" (UniqueName: \"kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9\") pod \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\" (UID: \"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0\") " Jul 22 12:56:04.501465 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501444 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-oauth-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.501633 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501607 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config" (OuterVolumeSpecName: "console-config") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:56:04.501707 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.501657 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca" (OuterVolumeSpecName: "service-ca") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:56:04.502974 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.502949 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:04.503139 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.503113 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:04.503227 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.503159 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9" (OuterVolumeSpecName: "kube-api-access-hfjf9") pod "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" (UID: "bbf00360-cc38-43c2-a2ca-b8eb0a681bc0"). InnerVolumeSpecName "kube-api-access-hfjf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:56:04.602781 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.602754 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.602781 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.602777 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-oauth-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.602781 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.602787 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.602964 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.602795 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfjf9\" (UniqueName: \"kubernetes.io/projected/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-kube-api-access-hfjf9\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.602964 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.602804 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0-console-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:04.642572 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:04.642541 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:05.058441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.058410 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:56:05.062073 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.062045 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77c44d85b4-tvqkn" Jul 22 12:56:05.261414 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.261378 2549 generic.go:356] "Generic (PLEG): container finished" podID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" containerID="843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237" exitCode=0 Jul 22 12:56:05.261862 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.261437 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69dfc96764-z4crz" Jul 22 12:56:05.261862 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.261456 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dfc96764-z4crz" event={"ID":"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0","Type":"ContainerDied","Data":"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237"} Jul 22 12:56:05.261862 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.261568 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69dfc96764-z4crz" event={"ID":"bbf00360-cc38-43c2-a2ca-b8eb0a681bc0","Type":"ContainerDied","Data":"e13e4f98a866c6867f9162303bff37db344448c8e7a446d2598ff477afbeb380"} Jul 22 12:56:05.261862 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.261595 2549 scope.go:117] "RemoveContainer" containerID="843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237" Jul 22 12:56:05.269941 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.269927 2549 scope.go:117] "RemoveContainer" containerID="843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237" Jul 22 12:56:05.270179 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:05.270159 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237\": container with ID starting with 843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237 not found: ID does not exist" containerID="843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237" Jul 22 12:56:05.270227 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.270187 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237"} err="failed to get container status \"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237\": rpc error: code = NotFound desc = could not find container \"843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237\": container with ID starting with 843a194841534e1b6f2534ab82479b1ff0870c92a742fdc090609fd3cabed237 not found: ID does not exist" Jul 22 12:56:05.283196 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.283175 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:56:05.287134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:05.287115 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69dfc96764-z4crz"] Jul 22 12:56:06.554709 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:06.554681 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" path="/var/lib/kubelet/pods/bbf00360-cc38-43c2-a2ca-b8eb0a681bc0/volumes" Jul 22 12:56:10.285799 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:10.285768 2549 generic.go:356] "Generic (PLEG): container finished" podID="6fd07149-cb96-4cec-a953-8a805c0089e4" containerID="63fd038357c7f0b3de708c7ab2b16443c977822d0d9d8dd227e2e1d501a9c794" exitCode=0 Jul 22 12:56:10.286232 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:10.285824 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" event={"ID":"6fd07149-cb96-4cec-a953-8a805c0089e4","Type":"ContainerDied","Data":"63fd038357c7f0b3de708c7ab2b16443c977822d0d9d8dd227e2e1d501a9c794"} Jul 22 12:56:10.286232 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:10.286135 2549 scope.go:117] "RemoveContainer" containerID="63fd038357c7f0b3de708c7ab2b16443c977822d0d9d8dd227e2e1d501a9c794" Jul 22 12:56:11.291952 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:11.291921 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rbkht" event={"ID":"6fd07149-cb96-4cec-a953-8a805c0089e4","Type":"ContainerStarted","Data":"394cb37673c5a7279c3249339022772dd0e53ce07d78cbd24cbed6d45ae05a80"} Jul 22 12:56:39.681123 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:39.681087 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:40.094398 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.094363 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:40.727439 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727407 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:40.727833 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727720 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="alertmanager" containerID="cri-o://9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" gracePeriod=120 Jul 22 12:56:40.727833 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727758 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-metric" containerID="cri-o://d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" gracePeriod=120 Jul 22 12:56:40.727833 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727811 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-web" containerID="cri-o://5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" gracePeriod=120 Jul 22 12:56:40.727985 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727829 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="prom-label-proxy" containerID="cri-o://ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" gracePeriod=120 Jul 22 12:56:40.727985 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727846 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy" containerID="cri-o://488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" gracePeriod=120 Jul 22 12:56:40.728819 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:40.727849 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="config-reloader" containerID="cri-o://49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" gracePeriod=120 Jul 22 12:56:41.413134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413104 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" exitCode=0 Jul 22 12:56:41.413134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413129 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" exitCode=0 Jul 22 12:56:41.413134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413137 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" exitCode=0 Jul 22 12:56:41.413134 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413146 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" exitCode=0 Jul 22 12:56:41.413404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413182 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851"} Jul 22 12:56:41.413404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413245 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b"} Jul 22 12:56:41.413404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413271 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21"} Jul 22 12:56:41.413404 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.413297 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e"} Jul 22 12:56:41.970412 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:41.970390 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.032907 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.032828 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.032907 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.032871 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.032907 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.032895 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.032925 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.032980 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pdfw\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033028 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033057 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033084 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033110 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033166 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033150 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033173 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033197 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033236 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume\") pod \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\" (UID: \"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0\") " Jul 22 12:56:42.033483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033295 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:56:42.033702 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.033552 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-metrics-client-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.034753 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.034723 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:56:42.035085 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.035058 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:56:42.035958 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.035928 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.036841 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.036813 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.037390 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.036965 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume" (OuterVolumeSpecName: "config-volume") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.037476 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.037446 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out" (OuterVolumeSpecName: "config-out") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:56:42.037591 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.037568 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.037664 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.037592 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:56:42.037814 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.037786 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.037969 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.037944 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw" (OuterVolumeSpecName: "kube-api-access-5pdfw") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "kube-api-access-5pdfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:56:42.041721 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.041567 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.048116 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.048093 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config" (OuterVolumeSpecName: "web-config") pod "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" (UID: "c2d8024f-1a61-4e11-9a2f-3caa4cc361f0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:56:42.134632 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134602 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-out\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134632 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134629 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-tls-assets\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134632 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134639 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134649 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-config-volume\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134658 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-cluster-tls-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134667 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134676 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134684 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pdfw\" (UniqueName: \"kubernetes.io/projected/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-kube-api-access-5pdfw\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134692 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-main-db\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134703 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-web-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134713 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.134885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.134722 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0-secret-alertmanager-main-tls\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:56:42.419598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419489 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" exitCode=0 Jul 22 12:56:42.419598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419532 2549 generic.go:356] "Generic (PLEG): container finished" podID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerID="5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" exitCode=0 Jul 22 12:56:42.419598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419558 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9"} Jul 22 12:56:42.419598 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419595 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.419849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419630 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1"} Jul 22 12:56:42.419849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2d8024f-1a61-4e11-9a2f-3caa4cc361f0","Type":"ContainerDied","Data":"a69a7ae602634d6d8a59fbc6f60408422f5c8514fba6b1bd679a4f34ecb5725b"} Jul 22 12:56:42.419849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.419686 2549 scope.go:117] "RemoveContainer" containerID="ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" Jul 22 12:56:42.427378 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.427324 2549 scope.go:117] "RemoveContainer" containerID="d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" Jul 22 12:56:42.434211 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.434194 2549 scope.go:117] "RemoveContainer" containerID="488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" Jul 22 12:56:42.440397 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.440381 2549 scope.go:117] "RemoveContainer" containerID="5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" Jul 22 12:56:42.445494 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.445465 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:42.447091 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.447077 2549 scope.go:117] "RemoveContainer" containerID="49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" Jul 22 12:56:42.452086 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.452066 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:42.453791 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.453774 2549 scope.go:117] "RemoveContainer" containerID="9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" Jul 22 12:56:42.461114 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.461081 2549 scope.go:117] "RemoveContainer" containerID="d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22" Jul 22 12:56:42.468580 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.468564 2549 scope.go:117] "RemoveContainer" containerID="ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" Jul 22 12:56:42.468930 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.468837 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851\": container with ID starting with ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851 not found: ID does not exist" containerID="ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" Jul 22 12:56:42.469000 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.468948 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851"} err="failed to get container status \"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851\": rpc error: code = NotFound desc = could not find container \"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851\": container with ID starting with ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851 not found: ID does not exist" Jul 22 12:56:42.469000 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.468969 2549 scope.go:117] "RemoveContainer" containerID="d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" Jul 22 12:56:42.469233 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.469215 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9\": container with ID starting with d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9 not found: ID does not exist" containerID="d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" Jul 22 12:56:42.469282 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469241 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9"} err="failed to get container status \"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9\": rpc error: code = NotFound desc = could not find container \"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9\": container with ID starting with d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9 not found: ID does not exist" Jul 22 12:56:42.469282 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469256 2549 scope.go:117] "RemoveContainer" containerID="488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" Jul 22 12:56:42.469486 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.469469 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b\": container with ID starting with 488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b not found: ID does not exist" containerID="488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" Jul 22 12:56:42.469556 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469491 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b"} err="failed to get container status \"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b\": rpc error: code = NotFound desc = could not find container \"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b\": container with ID starting with 488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b not found: ID does not exist" Jul 22 12:56:42.469556 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469505 2549 scope.go:117] "RemoveContainer" containerID="5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" Jul 22 12:56:42.469801 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.469786 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1\": container with ID starting with 5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1 not found: ID does not exist" containerID="5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" Jul 22 12:56:42.469857 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469806 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1"} err="failed to get container status \"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1\": rpc error: code = NotFound desc = could not find container \"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1\": container with ID starting with 5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1 not found: ID does not exist" Jul 22 12:56:42.469857 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.469820 2549 scope.go:117] "RemoveContainer" containerID="49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" Jul 22 12:56:42.470050 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.470033 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21\": container with ID starting with 49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21 not found: ID does not exist" containerID="49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" Jul 22 12:56:42.470089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470053 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21"} err="failed to get container status \"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21\": rpc error: code = NotFound desc = could not find container \"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21\": container with ID starting with 49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21 not found: ID does not exist" Jul 22 12:56:42.470089 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470066 2549 scope.go:117] "RemoveContainer" containerID="9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" Jul 22 12:56:42.470293 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.470277 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e\": container with ID starting with 9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e not found: ID does not exist" containerID="9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" Jul 22 12:56:42.470331 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470297 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e"} err="failed to get container status \"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e\": rpc error: code = NotFound desc = could not find container \"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e\": container with ID starting with 9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e not found: ID does not exist" Jul 22 12:56:42.470331 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470310 2549 scope.go:117] "RemoveContainer" containerID="d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22" Jul 22 12:56:42.470552 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:56:42.470526 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22\": container with ID starting with d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22 not found: ID does not exist" containerID="d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22" Jul 22 12:56:42.470648 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470555 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22"} err="failed to get container status \"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22\": rpc error: code = NotFound desc = could not find container \"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22\": container with ID starting with d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22 not found: ID does not exist" Jul 22 12:56:42.470648 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470574 2549 scope.go:117] "RemoveContainer" containerID="ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851" Jul 22 12:56:42.470835 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470815 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851"} err="failed to get container status \"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851\": rpc error: code = NotFound desc = could not find container \"ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851\": container with ID starting with ad15e5d5c67f955aed6520136242c226e7575311ee426dc78ef0070fab9d2851 not found: ID does not exist" Jul 22 12:56:42.470930 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.470837 2549 scope.go:117] "RemoveContainer" containerID="d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9" Jul 22 12:56:42.471085 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471067 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9"} err="failed to get container status \"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9\": rpc error: code = NotFound desc = could not find container \"d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9\": container with ID starting with d8e4ecc1efcae06aca2baec604c1ea5f65b2a9068448fd486dbd749d8a3652f9 not found: ID does not exist" Jul 22 12:56:42.471139 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471086 2549 scope.go:117] "RemoveContainer" containerID="488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b" Jul 22 12:56:42.471337 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471308 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b"} err="failed to get container status \"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b\": rpc error: code = NotFound desc = could not find container \"488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b\": container with ID starting with 488c3d0d266415159e46ebae47a5e4ed9572fee52a11a80246d64e8f666d7a4b not found: ID does not exist" Jul 22 12:56:42.471413 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471339 2549 scope.go:117] "RemoveContainer" containerID="5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1" Jul 22 12:56:42.471636 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471619 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1"} err="failed to get container status \"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1\": rpc error: code = NotFound desc = could not find container \"5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1\": container with ID starting with 5413a58ca0a5d9d1f8669294c728fb51483276a41f5e076de5cc5f172a1f5ed1 not found: ID does not exist" Jul 22 12:56:42.471710 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471637 2549 scope.go:117] "RemoveContainer" containerID="49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21" Jul 22 12:56:42.471833 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471814 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21"} err="failed to get container status \"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21\": rpc error: code = NotFound desc = could not find container \"49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21\": container with ID starting with 49eea57c72898b9d644c35f336726bdb9fe42c43b5f2620cd01cf3ced4b2eb21 not found: ID does not exist" Jul 22 12:56:42.471892 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.471834 2549 scope.go:117] "RemoveContainer" containerID="9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e" Jul 22 12:56:42.472039 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.472024 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e"} err="failed to get container status \"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e\": rpc error: code = NotFound desc = could not find container \"9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e\": container with ID starting with 9ccd5b6ef288fd4930e1da38cde1d098fe58ffb5704fba347f86b63143c3b50e not found: ID does not exist" Jul 22 12:56:42.472083 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.472039 2549 scope.go:117] "RemoveContainer" containerID="d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22" Jul 22 12:56:42.472249 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.472230 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22"} err="failed to get container status \"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22\": rpc error: code = NotFound desc = could not find container \"d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22\": container with ID starting with d56f764f9bd9e74f148dcdd1b132f852f93a2abd278130151800b6fb3b4e2e22 not found: ID does not exist" Jul 22 12:56:42.478480 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478458 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:42.478781 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478765 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-web" Jul 22 12:56:42.478852 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478783 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-web" Jul 22 12:56:42.478852 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478802 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="init-config-reloader" Jul 22 12:56:42.478852 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478811 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="init-config-reloader" Jul 22 12:56:42.478852 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478823 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" containerName="console" Jul 22 12:56:42.478852 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478831 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" containerName="console" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478864 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerName="registry" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478873 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerName="registry" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478885 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478893 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478903 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="prom-label-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478912 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="prom-label-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478925 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="config-reloader" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478935 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="config-reloader" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478951 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-metric" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478960 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-metric" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478977 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="alertmanager" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.478985 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="alertmanager" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479065 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="prom-label-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479079 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf00360-cc38-43c2-a2ca-b8eb0a681bc0" containerName="console" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479088 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-web" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479097 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc968cce-c6a0-4b3b-96ca-c30853b8a2f6" containerName="registry" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479106 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy" Jul 22 12:56:42.479112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479114 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="kube-rbac-proxy-metric" Jul 22 12:56:42.479971 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479122 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="alertmanager" Jul 22 12:56:42.479971 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.479130 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" containerName="config-reloader" Jul 22 12:56:42.485132 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.484995 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.487761 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.487723 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 12:56:42.487761 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.487747 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 12:56:42.487903 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.487758 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 12:56:42.487903 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.487748 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 12:56:42.488548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.488382 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 12:56:42.488548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.488385 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 12:56:42.488548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.488386 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 12:56:42.488548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.488444 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 12:56:42.488548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.488453 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7mzxp\"" Jul 22 12:56:42.493115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.493096 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 12:56:42.495697 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.495679 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:42.538572 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538545 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-web-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538694 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538586 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538694 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538612 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538694 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538635 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538688 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538764 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538790 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.538848 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538813 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.539090 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm95t\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-kube-api-access-vm95t\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.539090 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538907 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-out\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.539090 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538942 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.539090 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.538980 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.554201 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.554167 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d8024f-1a61-4e11-9a2f-3caa4cc361f0" path="/var/lib/kubelet/pods/c2d8024f-1a61-4e11-9a2f-3caa4cc361f0/volumes" Jul 22 12:56:42.640024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.639993 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640032 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-web-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640140 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640187 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640210 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640240 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640267 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640289 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm95t\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-kube-api-access-vm95t\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640366 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-out\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.640548 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640421 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.641330 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.640645 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.641330 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.641262 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.642204 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.642174 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643227 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643399 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643428 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-volume\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643483 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643442 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643700 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643581 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.643700 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.643660 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.644383 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.644363 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-web-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.644447 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.644422 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.644993 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.644974 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-config-out\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.650499 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.650482 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm95t\" (UniqueName: \"kubernetes.io/projected/dfbf746d-0e85-4e2b-b82a-7ae9d64d2932-kube-api-access-vm95t\") pod \"alertmanager-main-0\" (UID: \"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.796121 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.796086 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 12:56:42.932222 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:42.932191 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 12:56:42.935549 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:56:42.935524 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbf746d_0e85_4e2b_b82a_7ae9d64d2932.slice/crio-49fecbdb7bc5e8c6a7b802715f7d06c15969d62193895dd153bb8e1533c735a9 WatchSource:0}: Error finding container 49fecbdb7bc5e8c6a7b802715f7d06c15969d62193895dd153bb8e1533c735a9: Status 404 returned error can't find the container with id 49fecbdb7bc5e8c6a7b802715f7d06c15969d62193895dd153bb8e1533c735a9 Jul 22 12:56:43.425149 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:43.425112 2549 generic.go:356] "Generic (PLEG): container finished" podID="dfbf746d-0e85-4e2b-b82a-7ae9d64d2932" containerID="60a073de0421623ef0cfa2a1d990b337ae340ade44228575b2e53b0f624bab58" exitCode=0 Jul 22 12:56:43.425642 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:43.425206 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerDied","Data":"60a073de0421623ef0cfa2a1d990b337ae340ade44228575b2e53b0f624bab58"} Jul 22 12:56:43.425642 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:43.425299 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"49fecbdb7bc5e8c6a7b802715f7d06c15969d62193895dd153bb8e1533c735a9"} Jul 22 12:56:44.432650 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432617 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"bf8f70110586a37a06750bedbe620a09d3002365e99256ca64df7ed0456b561c"} Jul 22 12:56:44.433024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432679 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"fc2c470e88f83dd067a5f4557e77abd90b127c57169668d6f54bfa3b14cc4855"} Jul 22 12:56:44.433024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432708 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"481868521ff56f505fcbe7a18ba7a8225b2a8053ad30ec33d136be9aa3380541"} Jul 22 12:56:44.433024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432732 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"488b3188e67c8c1739a548214760e0e36f537fdfbd0e2925a2f22b03dbd8678d"} Jul 22 12:56:44.433024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432769 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"5e000f5ad63a8fca9a2456691bc7f1c3700bec360b75120e54d2051448aa560e"} Jul 22 12:56:44.433024 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.432793 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dfbf746d-0e85-4e2b-b82a-7ae9d64d2932","Type":"ContainerStarted","Data":"22a071cd708ee8a7e7b27af6d38728e0c3bdafcafce24c5aad810223edff4a16"} Jul 22 12:56:44.462059 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.461924 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.446029367 podStartE2EDuration="2.461904826s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.875459ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:56:44.460059729 +0000 UTC m=+174.346696395" watchObservedRunningTime="2026-07-22 12:56:44.461904826 +0000 UTC m=+174.348541494" Jul 22 12:56:44.772887 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.772845 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67d849dbbd-b9gjr"] Jul 22 12:56:44.776419 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.776398 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.779031 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779006 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 22 12:56:44.779175 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779051 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 22 12:56:44.779257 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779209 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 22 12:56:44.779257 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779219 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 22 12:56:44.779357 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779317 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nd5ng\"" Jul 22 12:56:44.779461 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.779445 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 22 12:56:44.785095 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.785077 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 22 12:56:44.790252 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.790231 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d849dbbd-b9gjr"] Jul 22 12:56:44.859767 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859733 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-metrics-client-ca\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859898 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859774 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-serving-certs-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859898 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859800 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtss\" (UniqueName: \"kubernetes.io/projected/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-kube-api-access-nbtss\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859891 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859948 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-federate-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.859999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.859987 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.860133 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.860012 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961029 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.960977 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961029 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961036 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961089 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-metrics-client-ca\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961119 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-serving-certs-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961151 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtss\" (UniqueName: \"kubernetes.io/projected/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-kube-api-access-nbtss\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961205 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961229 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961266 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-federate-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.961975 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.961948 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-serving-certs-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.962097 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.962034 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.962097 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.962069 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-metrics-client-ca\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.963705 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.963678 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.963705 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.963691 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-federate-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.963984 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.963955 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-telemeter-client-tls\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.964129 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.964109 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-secret-telemeter-client\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:44.969672 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:44.969648 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtss\" (UniqueName: \"kubernetes.io/projected/c69b961b-dfc2-450e-a58e-13cbc74b4ba6-kube-api-access-nbtss\") pod \"telemeter-client-67d849dbbd-b9gjr\" (UID: \"c69b961b-dfc2-450e-a58e-13cbc74b4ba6\") " pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:45.086272 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:45.086092 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" Jul 22 12:56:45.221833 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:45.221808 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67d849dbbd-b9gjr"] Jul 22 12:56:45.224079 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:56:45.224048 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69b961b_dfc2_450e_a58e_13cbc74b4ba6.slice/crio-aa3e2ed7e9d018fbbb84c749d5a414eba4edde5167dbc9be000ab3b2e43018ff WatchSource:0}: Error finding container aa3e2ed7e9d018fbbb84c749d5a414eba4edde5167dbc9be000ab3b2e43018ff: Status 404 returned error can't find the container with id aa3e2ed7e9d018fbbb84c749d5a414eba4edde5167dbc9be000ab3b2e43018ff Jul 22 12:56:45.439029 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:45.438948 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" event={"ID":"c69b961b-dfc2-450e-a58e-13cbc74b4ba6","Type":"ContainerStarted","Data":"aa3e2ed7e9d018fbbb84c749d5a414eba4edde5167dbc9be000ab3b2e43018ff"} Jul 22 12:56:47.451416 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:47.451383 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" event={"ID":"c69b961b-dfc2-450e-a58e-13cbc74b4ba6","Type":"ContainerStarted","Data":"014efab3a7ad78b334d01b72bcd9de7d86d25f1dedc0b96a5033807442d0fe62"} Jul 22 12:56:47.451803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:47.451445 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" event={"ID":"c69b961b-dfc2-450e-a58e-13cbc74b4ba6","Type":"ContainerStarted","Data":"57f45ba895f8d56f6d4e76a4af8b977c656041608fe2af8e8e8e5e06a597588a"} Jul 22 12:56:47.451803 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:47.451466 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" event={"ID":"c69b961b-dfc2-450e-a58e-13cbc74b4ba6","Type":"ContainerStarted","Data":"1245191150ad1c834c5be5bf543fc4c774d09223f560ab29ec3ccfe366a5fd9b"} Jul 22 12:56:47.475886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:47.475837 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67d849dbbd-b9gjr" podStartSLOduration=1.46274488 podStartE2EDuration="3.475820278s" totalImagesPullingTime="2.013075398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:56:47.473276998 +0000 UTC m=+177.359913665" watchObservedRunningTime="2026-07-22 12:56:47.475820278 +0000 UTC m=+177.362456945" Jul 22 12:56:48.485932 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.485897 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:56:48.490203 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.490179 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.502415 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.502386 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:56:48.544316 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.544286 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:48.593221 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593186 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593221 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593248 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593302 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk6fd\" (UniqueName: \"kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593342 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.593410 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.593368 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.598247 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.598219 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:48.694190 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694156 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694204 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk6fd\" (UniqueName: \"kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694226 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694261 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694308 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.694364 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.694329 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.695080 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.695055 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.695182 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.695110 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.695182 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.695121 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.695297 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.695278 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.697309 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.697279 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.697388 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.697350 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.703463 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.703441 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk6fd\" (UniqueName: \"kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd\") pod \"console-566484d779-9mst9\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.801210 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.801174 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:48.928606 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:48.928580 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:56:48.931045 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:56:48.931021 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25839d9_a546_4048_bc48_b1506168e5ff.slice/crio-0adff58f4a016ca75e6e7184a60d4404d0083a6c6ce932217caa496c16501411 WatchSource:0}: Error finding container 0adff58f4a016ca75e6e7184a60d4404d0083a6c6ce932217caa496c16501411: Status 404 returned error can't find the container with id 0adff58f4a016ca75e6e7184a60d4404d0083a6c6ce932217caa496c16501411 Jul 22 12:56:49.461783 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:49.461749 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566484d779-9mst9" event={"ID":"a25839d9-a546-4048-bc48-b1506168e5ff","Type":"ContainerStarted","Data":"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b"} Jul 22 12:56:49.461952 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:49.461798 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566484d779-9mst9" event={"ID":"a25839d9-a546-4048-bc48-b1506168e5ff","Type":"ContainerStarted","Data":"0adff58f4a016ca75e6e7184a60d4404d0083a6c6ce932217caa496c16501411"} Jul 22 12:56:49.480104 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:49.480051 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566484d779-9mst9" podStartSLOduration=1.4800358949999999 podStartE2EDuration="1.480035895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:56:49.479720062 +0000 UTC m=+179.366356729" watchObservedRunningTime="2026-07-22 12:56:49.480035895 +0000 UTC m=+179.366672561" Jul 22 12:56:58.801793 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:58.801759 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:58.802203 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:58.801816 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:58.806493 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:58.806472 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:59.503780 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:59.503751 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:56:59.556292 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:59.556256 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:56:59.675259 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:59.675223 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:59.771983 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:59.771939 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:56:59.829933 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:56:59.829904 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:13.707437 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:13.707405 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:20.364342 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:20.364301 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:20.430995 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:20.430965 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:24.579869 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:24.579819 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ffb8b669c-d7bgn" podUID="df6b354c-36e7-4783-981b-9ce565ae628f" containerName="console" containerID="cri-o://0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad" gracePeriod=15 Jul 22 12:57:24.820013 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:24.819986 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:57:25.006010 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.005921 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006010 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.005969 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7fhj\" (UniqueName: \"kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006010 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006004 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006298 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006023 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006298 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006088 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006298 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006129 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006298 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006153 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config\") pod \"df6b354c-36e7-4783-981b-9ce565ae628f\" (UID: \"df6b354c-36e7-4783-981b-9ce565ae628f\") " Jul 22 12:57:25.006493 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006451 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:57:25.006594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006566 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca" (OuterVolumeSpecName: "service-ca") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:57:25.006713 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006685 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config" (OuterVolumeSpecName: "console-config") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:57:25.006765 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.006712 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:57:25.008347 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.008322 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:57:25.008708 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.008689 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:57:25.008764 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.008705 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj" (OuterVolumeSpecName: "kube-api-access-b7fhj") pod "df6b354c-36e7-4783-981b-9ce565ae628f" (UID: "df6b354c-36e7-4783-981b-9ce565ae628f"). InnerVolumeSpecName "kube-api-access-b7fhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:57:25.107124 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107093 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-trusted-ca-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107124 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107121 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7fhj\" (UniqueName: \"kubernetes.io/projected/df6b354c-36e7-4783-981b-9ce565ae628f-kube-api-access-b7fhj\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107124 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107133 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107353 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107142 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107353 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107152 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-console-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107353 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107160 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df6b354c-36e7-4783-981b-9ce565ae628f-oauth-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.107353 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.107168 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df6b354c-36e7-4783-981b-9ce565ae628f-console-oauth-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:57:25.597782 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.597750 2549 generic.go:356] "Generic (PLEG): container finished" podID="df6b354c-36e7-4783-981b-9ce565ae628f" containerID="0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad" exitCode=0 Jul 22 12:57:25.598209 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.597796 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb8b669c-d7bgn" Jul 22 12:57:25.598209 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.597804 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb8b669c-d7bgn" event={"ID":"df6b354c-36e7-4783-981b-9ce565ae628f","Type":"ContainerDied","Data":"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad"} Jul 22 12:57:25.598209 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.597844 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb8b669c-d7bgn" event={"ID":"df6b354c-36e7-4783-981b-9ce565ae628f","Type":"ContainerDied","Data":"1b8ee002a8ffb5b92528f8379c32c7c43d003c2d1ca80237ed3a3130c085498d"} Jul 22 12:57:25.598209 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.597863 2549 scope.go:117] "RemoveContainer" containerID="0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad" Jul 22 12:57:25.606336 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.606318 2549 scope.go:117] "RemoveContainer" containerID="0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad" Jul 22 12:57:25.606568 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:57:25.606549 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad\": container with ID starting with 0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad not found: ID does not exist" containerID="0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad" Jul 22 12:57:25.606620 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.606577 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad"} err="failed to get container status \"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad\": rpc error: code = NotFound desc = could not find container \"0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad\": container with ID starting with 0f33c81df29b43056560288d4ed77787bb50bdc7b245791a9c55b651a6eae1ad not found: ID does not exist" Jul 22 12:57:25.621443 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.621420 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:57:25.625872 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:25.625854 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ffb8b669c-d7bgn"] Jul 22 12:57:26.554011 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:26.553969 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df6b354c-36e7-4783-981b-9ce565ae628f" path="/var/lib/kubelet/pods/df6b354c-36e7-4783-981b-9ce565ae628f/volumes" Jul 22 12:57:54.911646 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:54.911610 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:54.969279 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:54.969248 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.010906 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.010865 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.118810 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.118777 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.178301 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.178269 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.501939 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.501858 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.576346 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.576315 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:57:56.741551 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:57:56.741501 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:06.745643 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:06.745611 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:58:06.914832 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:06.914727 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:07.014452 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:07.014422 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:12.348266 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:12.348229 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:12.447723 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:12.447685 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:12.547700 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:12.547666 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:31.770045 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:31.769982 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-566484d779-9mst9" podUID="a25839d9-a546-4048-bc48-b1506168e5ff" containerName="console" containerID="cri-o://ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b" gracePeriod=15 Jul 22 12:58:32.018809 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.018780 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:58:32.066654 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066580 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.066654 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066613 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.066654 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066638 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.066883 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066668 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk6fd\" (UniqueName: \"kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.066883 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066866 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.066985 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.066955 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.067034 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067013 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:58:32.067088 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067019 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config\") pod \"a25839d9-a546-4048-bc48-b1506168e5ff\" (UID: \"a25839d9-a546-4048-bc48-b1506168e5ff\") " Jul 22 12:58:32.067088 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067028 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:58:32.067330 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067296 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:58:32.067441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067335 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config" (OuterVolumeSpecName: "console-config") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 12:58:32.067489 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067452 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.067489 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067471 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-oauth-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.067489 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067485 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-trusted-ca-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.067621 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.067500 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25839d9-a546-4048-bc48-b1506168e5ff-console-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.068884 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.068853 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd" (OuterVolumeSpecName: "kube-api-access-nk6fd") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "kube-api-access-nk6fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:58:32.068974 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.068880 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:58:32.068974 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.068925 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a25839d9-a546-4048-bc48-b1506168e5ff" (UID: "a25839d9-a546-4048-bc48-b1506168e5ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 12:58:32.168074 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.168033 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-serving-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.168074 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.168066 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25839d9-a546-4048-bc48-b1506168e5ff-console-oauth-config\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.168074 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.168081 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk6fd\" (UniqueName: \"kubernetes.io/projected/a25839d9-a546-4048-bc48-b1506168e5ff-kube-api-access-nk6fd\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:58:32.863300 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.863214 2549 generic.go:356] "Generic (PLEG): container finished" podID="a25839d9-a546-4048-bc48-b1506168e5ff" containerID="ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b" exitCode=0 Jul 22 12:58:32.863300 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.863257 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566484d779-9mst9" Jul 22 12:58:32.863755 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.863304 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566484d779-9mst9" event={"ID":"a25839d9-a546-4048-bc48-b1506168e5ff","Type":"ContainerDied","Data":"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b"} Jul 22 12:58:32.863755 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.863349 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566484d779-9mst9" event={"ID":"a25839d9-a546-4048-bc48-b1506168e5ff","Type":"ContainerDied","Data":"0adff58f4a016ca75e6e7184a60d4404d0083a6c6ce932217caa496c16501411"} Jul 22 12:58:32.863755 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.863370 2549 scope.go:117] "RemoveContainer" containerID="ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b" Jul 22 12:58:32.871325 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.871309 2549 scope.go:117] "RemoveContainer" containerID="ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b" Jul 22 12:58:32.871608 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:58:32.871590 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b\": container with ID starting with ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b not found: ID does not exist" containerID="ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b" Jul 22 12:58:32.871664 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.871618 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b"} err="failed to get container status \"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b\": rpc error: code = NotFound desc = could not find container \"ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b\": container with ID starting with ba896272fb5d1c9f51193d0f04b992074d25a36d5dec20802ebb3b0d6c7d474b not found: ID does not exist" Jul 22 12:58:32.882874 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.882855 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:58:32.887928 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:32.887907 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566484d779-9mst9"] Jul 22 12:58:34.554058 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:34.554026 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a25839d9-a546-4048-bc48-b1506168e5ff" path="/var/lib/kubelet/pods/a25839d9-a546-4048-bc48-b1506168e5ff/volumes" Jul 22 12:58:50.443886 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:50.443855 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 12:58:50.447165 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:50.447140 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 12:58:50.454073 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:50.454055 2549 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 12:58:55.804662 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:55.804623 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:56.534791 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.534755 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff"] Jul 22 12:58:56.535138 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535121 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df6b354c-36e7-4783-981b-9ce565ae628f" containerName="console" Jul 22 12:58:56.535215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535141 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="df6b354c-36e7-4783-981b-9ce565ae628f" containerName="console" Jul 22 12:58:56.535215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535155 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25839d9-a546-4048-bc48-b1506168e5ff" containerName="console" Jul 22 12:58:56.535215 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535163 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25839d9-a546-4048-bc48-b1506168e5ff" containerName="console" Jul 22 12:58:56.535359 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535261 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a25839d9-a546-4048-bc48-b1506168e5ff" containerName="console" Jul 22 12:58:56.535359 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.535275 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="df6b354c-36e7-4783-981b-9ce565ae628f" containerName="console" Jul 22 12:58:56.538358 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.538337 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.541197 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.541171 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:58:56.542277 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.542257 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6xmc\"" Jul 22 12:58:56.542277 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.542270 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:58:56.546508 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.546485 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff"] Jul 22 12:58:56.677000 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.676966 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.677171 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.677016 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.677171 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.677045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwt9\" (UniqueName: \"kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.777912 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.777876 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.777912 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.777917 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwt9\" (UniqueName: \"kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.778158 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.777999 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.778339 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.778317 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.778400 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.778364 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.789071 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.789017 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwt9\" (UniqueName: \"kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.847825 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.847788 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:58:56.980218 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.980185 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff"] Jul 22 12:58:56.982360 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:58:56.982337 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba4c173_7aab_4469_b96d_fc61826995ce.slice/crio-9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb WatchSource:0}: Error finding container 9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb: Status 404 returned error can't find the container with id 9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb Jul 22 12:58:56.984262 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:56.984241 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 12:58:57.419729 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:57.419696 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:58:57.963748 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:58:57.963716 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" event={"ID":"bba4c173-7aab-4469-b96d-fc61826995ce","Type":"ContainerStarted","Data":"9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb"} Jul 22 12:59:03.990149 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:03.990115 2549 generic.go:356] "Generic (PLEG): container finished" podID="bba4c173-7aab-4469-b96d-fc61826995ce" containerID="e6c063af510a9b86671bc592a09f2dfb506998f6652b3dae69d67513d5902f66" exitCode=0 Jul 22 12:59:03.990602 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:03.990197 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" event={"ID":"bba4c173-7aab-4469-b96d-fc61826995ce","Type":"ContainerDied","Data":"e6c063af510a9b86671bc592a09f2dfb506998f6652b3dae69d67513d5902f66"} Jul 22 12:59:10.016949 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:10.016911 2549 generic.go:356] "Generic (PLEG): container finished" podID="bba4c173-7aab-4469-b96d-fc61826995ce" containerID="51ac2fc9a3920e3b11f826eb578e6b8491e7954f0865948f750ab5e99ee031cc" exitCode=0 Jul 22 12:59:10.017339 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:10.016995 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" event={"ID":"bba4c173-7aab-4469-b96d-fc61826995ce","Type":"ContainerDied","Data":"51ac2fc9a3920e3b11f826eb578e6b8491e7954f0865948f750ab5e99ee031cc"} Jul 22 12:59:17.051761 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:17.051719 2549 generic.go:356] "Generic (PLEG): container finished" podID="bba4c173-7aab-4469-b96d-fc61826995ce" containerID="06630df0ba7f47d67b7a772fe6ad445b771738d734a3066d59aa0464af235166" exitCode=0 Jul 22 12:59:17.052212 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:17.051775 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" event={"ID":"bba4c173-7aab-4469-b96d-fc61826995ce","Type":"ContainerDied","Data":"06630df0ba7f47d67b7a772fe6ad445b771738d734a3066d59aa0464af235166"} Jul 22 12:59:18.178320 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.178295 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:59:18.254601 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.254570 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle\") pod \"bba4c173-7aab-4469-b96d-fc61826995ce\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " Jul 22 12:59:18.254778 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.254637 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util\") pod \"bba4c173-7aab-4469-b96d-fc61826995ce\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " Jul 22 12:59:18.254778 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.254692 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szwt9\" (UniqueName: \"kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9\") pod \"bba4c173-7aab-4469-b96d-fc61826995ce\" (UID: \"bba4c173-7aab-4469-b96d-fc61826995ce\") " Jul 22 12:59:18.255268 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.255244 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle" (OuterVolumeSpecName: "bundle") pod "bba4c173-7aab-4469-b96d-fc61826995ce" (UID: "bba4c173-7aab-4469-b96d-fc61826995ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:18.256920 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.256895 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9" (OuterVolumeSpecName: "kube-api-access-szwt9") pod "bba4c173-7aab-4469-b96d-fc61826995ce" (UID: "bba4c173-7aab-4469-b96d-fc61826995ce"). InnerVolumeSpecName "kube-api-access-szwt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:59:18.258622 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.258600 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util" (OuterVolumeSpecName: "util") pod "bba4c173-7aab-4469-b96d-fc61826995ce" (UID: "bba4c173-7aab-4469-b96d-fc61826995ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:18.355609 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.355498 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:18.355609 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.355554 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwt9\" (UniqueName: \"kubernetes.io/projected/bba4c173-7aab-4469-b96d-fc61826995ce-kube-api-access-szwt9\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:18.355609 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:18.355566 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bba4c173-7aab-4469-b96d-fc61826995ce-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:19.060988 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:19.060962 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" Jul 22 12:59:19.061153 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:19.060957 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cj9ff" event={"ID":"bba4c173-7aab-4469-b96d-fc61826995ce","Type":"ContainerDied","Data":"9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb"} Jul 22 12:59:19.061153 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:19.061100 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9607330d4561cfcec83209ae108ed265043ab8769777cf7185e0d236491c56cb" Jul 22 12:59:22.613904 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:22.613870 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:23.593887 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:23.593858 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:26.446242 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:26.446208 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:26.542746 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:26.542711 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:28.894112 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:28.894027 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:28.995136 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:28.995100 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:29.412153 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.412118 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:29.540594 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540563 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth"] Jul 22 12:59:29.540898 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540884 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="extract" Jul 22 12:59:29.540951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540901 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="extract" Jul 22 12:59:29.540951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540912 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="util" Jul 22 12:59:29.540951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540918 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="util" Jul 22 12:59:29.540951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540932 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="pull" Jul 22 12:59:29.540951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540937 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="pull" Jul 22 12:59:29.541115 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.540988 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba4c173-7aab-4469-b96d-fc61826995ce" containerName="extract" Jul 22 12:59:29.544458 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.544437 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.546867 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.546841 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6xmc\"" Jul 22 12:59:29.547040 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.547020 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:59:29.548072 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.548055 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:59:29.564131 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.564106 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth"] Jul 22 12:59:29.630161 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.630125 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.630329 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.630233 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.630329 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.630253 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvfpq\" (UniqueName: \"kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.731625 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.731541 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.731625 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.731597 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.731625 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.731617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvfpq\" (UniqueName: \"kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.731917 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.731898 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.731956 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.731927 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.749441 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.749417 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvfpq\" (UniqueName: \"kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.853277 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.853241 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:29.940638 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.940572 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:29.981711 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:29.981665 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth"] Jul 22 12:59:29.984112 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:59:29.984078 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dec6f6c_fad8_465d_9602_3449a100598f.slice/crio-56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7 WatchSource:0}: Error finding container 56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7: Status 404 returned error can't find the container with id 56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7 Jul 22 12:59:30.083276 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.083245 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6td65"] Jul 22 12:59:30.085156 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.085141 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.087883 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.087864 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 12:59:30.087980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.087904 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 12:59:30.087980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.087954 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n2f5t\"" Jul 22 12:59:30.096687 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.096662 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6td65"] Jul 22 12:59:30.104294 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.104268 2549 generic.go:356] "Generic (PLEG): container finished" podID="9dec6f6c-fad8-465d-9602-3449a100598f" containerID="d8a2459464d2b0ebb1b3101633f3052e2d49b2b686213b9acaa94bd67afb79f6" exitCode=0 Jul 22 12:59:30.104402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.104305 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" event={"ID":"9dec6f6c-fad8-465d-9602-3449a100598f","Type":"ContainerDied","Data":"d8a2459464d2b0ebb1b3101633f3052e2d49b2b686213b9acaa94bd67afb79f6"} Jul 22 12:59:30.104402 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.104352 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" event={"ID":"9dec6f6c-fad8-465d-9602-3449a100598f","Type":"ContainerStarted","Data":"56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7"} Jul 22 12:59:30.134660 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.134631 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.134660 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.134667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvn9j\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-kube-api-access-cvn9j\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.235849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.235769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.235849 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.235807 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvn9j\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-kube-api-access-cvn9j\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.246119 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.246090 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.246273 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.246251 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvn9j\" (UniqueName: \"kubernetes.io/projected/a1352b28-3fa5-4cbc-8f4b-080d148a9194-kube-api-access-cvn9j\") pod \"cert-manager-webhook-6486ffd997-6td65\" (UID: \"a1352b28-3fa5-4cbc-8f4b-080d148a9194\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.446923 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.446890 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:30.579862 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:30.579836 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6td65"] Jul 22 12:59:30.581708 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:59:30.581681 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1352b28_3fa5_4cbc_8f4b_080d148a9194.slice/crio-38d0056000754c01f2b39f4a752f4c48cf14d1bfa8c0eb0be04b3d1b3d99409e WatchSource:0}: Error finding container 38d0056000754c01f2b39f4a752f4c48cf14d1bfa8c0eb0be04b3d1b3d99409e: Status 404 returned error can't find the container with id 38d0056000754c01f2b39f4a752f4c48cf14d1bfa8c0eb0be04b3d1b3d99409e Jul 22 12:59:31.110072 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.109986 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" event={"ID":"a1352b28-3fa5-4cbc-8f4b-080d148a9194","Type":"ContainerStarted","Data":"38d0056000754c01f2b39f4a752f4c48cf14d1bfa8c0eb0be04b3d1b3d99409e"} Jul 22 12:59:31.200815 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.200783 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:31.344723 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.344678 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:31.707951 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.707919 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn"] Jul 22 12:59:31.710412 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.710392 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.713094 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.713066 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j9cfp\"" Jul 22 12:59:31.726696 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.726664 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn"] Jul 22 12:59:31.747685 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.747633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.747866 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.747714 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v7vh\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-kube-api-access-7v7vh\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.848845 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.848802 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.849038 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.848874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v7vh\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-kube-api-access-7v7vh\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.859874 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.859842 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:31.860026 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:31.859940 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v7vh\" (UniqueName: \"kubernetes.io/projected/03ecba14-990d-4d23-a939-68a2c5da2489-kube-api-access-7v7vh\") pod \"cert-manager-cainjector-559cdd8c87-bc5rn\" (UID: \"03ecba14-990d-4d23-a939-68a2c5da2489\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:32.021509 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:32.021470 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" Jul 22 12:59:32.182579 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:32.182552 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn"] Jul 22 12:59:32.185087 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:59:32.185057 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03ecba14_990d_4d23_a939_68a2c5da2489.slice/crio-ab907106b144083cf513638f4f1a5fabd74ce2798e6c51f4f0ba4fceb223dda4 WatchSource:0}: Error finding container ab907106b144083cf513638f4f1a5fabd74ce2798e6c51f4f0ba4fceb223dda4: Status 404 returned error can't find the container with id ab907106b144083cf513638f4f1a5fabd74ce2798e6c51f4f0ba4fceb223dda4 Jul 22 12:59:33.121013 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:33.120979 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" event={"ID":"03ecba14-990d-4d23-a939-68a2c5da2489","Type":"ContainerStarted","Data":"ab907106b144083cf513638f4f1a5fabd74ce2798e6c51f4f0ba4fceb223dda4"} Jul 22 12:59:33.229972 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:33.229886 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:33.329432 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:33.329394 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:34.127482 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:34.127449 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" event={"ID":"a1352b28-3fa5-4cbc-8f4b-080d148a9194","Type":"ContainerStarted","Data":"4f8d29484985e6ae622b3d6496539ca805fb9f82bfe3792f8d83cc340e9ba8f1"} Jul 22 12:59:34.127687 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:34.127540 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:34.128984 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:34.128961 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" event={"ID":"03ecba14-990d-4d23-a939-68a2c5da2489","Type":"ContainerStarted","Data":"d70011f0c41d6c641cdeb79ce6537353ebda019518f3e48172feecb1aff175aa"} Jul 22 12:59:34.156217 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:34.156170 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" podStartSLOduration=1.3132633870000001 podStartE2EDuration="4.156155569s" totalImagesPullingTime="2.842892182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:59:34.153756723 +0000 UTC m=+344.040393392" watchObservedRunningTime="2026-07-22 12:59:34.156155569 +0000 UTC m=+344.042792236" Jul 22 12:59:34.178920 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:34.178876 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bc5rn" podStartSLOduration=1.9393250659999999 podStartE2EDuration="3.178860383s" totalImagesPullingTime="1.239535317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:59:34.176830009 +0000 UTC m=+344.063466677" watchObservedRunningTime="2026-07-22 12:59:34.178860383 +0000 UTC m=+344.065497049" Jul 22 12:59:39.127562 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:39.127502 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:40.134558 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:40.134499 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6td65" Jul 22 12:59:41.161950 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:41.161920 2549 generic.go:356] "Generic (PLEG): container finished" podID="9dec6f6c-fad8-465d-9602-3449a100598f" containerID="f51f3b5409d458f48504840bb4aca92ef9bc5befbda1a9cfa7c0c742992edf22" exitCode=0 Jul 22 12:59:41.162358 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:41.162002 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" event={"ID":"9dec6f6c-fad8-465d-9602-3449a100598f","Type":"ContainerDied","Data":"f51f3b5409d458f48504840bb4aca92ef9bc5befbda1a9cfa7c0c742992edf22"} Jul 22 12:59:41.310465 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:59:41.310432 2549 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dec6f6c_fad8_465d_9602_3449a100598f.slice/crio-820cea77b9df81e53abba9079b78992c8a26eb7219427735ab3514b99924bb30.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dec6f6c_fad8_465d_9602_3449a100598f.slice/crio-conmon-820cea77b9df81e53abba9079b78992c8a26eb7219427735ab3514b99924bb30.scope\": RecentStats: unable to find data in memory cache]" Jul 22 12:59:42.168939 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:42.168904 2549 generic.go:356] "Generic (PLEG): container finished" podID="9dec6f6c-fad8-465d-9602-3449a100598f" containerID="820cea77b9df81e53abba9079b78992c8a26eb7219427735ab3514b99924bb30" exitCode=0 Jul 22 12:59:42.169329 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:42.168972 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" event={"ID":"9dec6f6c-fad8-465d-9602-3449a100598f","Type":"ContainerDied","Data":"820cea77b9df81e53abba9079b78992c8a26eb7219427735ab3514b99924bb30"} Jul 22 12:59:43.322289 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.322259 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:43.348980 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.348947 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util\") pod \"9dec6f6c-fad8-465d-9602-3449a100598f\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " Jul 22 12:59:43.349113 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.349008 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle\") pod \"9dec6f6c-fad8-465d-9602-3449a100598f\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " Jul 22 12:59:43.349113 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.349031 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvfpq\" (UniqueName: \"kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq\") pod \"9dec6f6c-fad8-465d-9602-3449a100598f\" (UID: \"9dec6f6c-fad8-465d-9602-3449a100598f\") " Jul 22 12:59:43.349401 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.349379 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle" (OuterVolumeSpecName: "bundle") pod "9dec6f6c-fad8-465d-9602-3449a100598f" (UID: "9dec6f6c-fad8-465d-9602-3449a100598f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:43.351072 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.351051 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq" (OuterVolumeSpecName: "kube-api-access-jvfpq") pod "9dec6f6c-fad8-465d-9602-3449a100598f" (UID: "9dec6f6c-fad8-465d-9602-3449a100598f"). InnerVolumeSpecName "kube-api-access-jvfpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:59:43.356765 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.356737 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util" (OuterVolumeSpecName: "util") pod "9dec6f6c-fad8-465d-9602-3449a100598f" (UID: "9dec6f6c-fad8-465d-9602-3449a100598f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:43.450555 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.450462 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:43.450555 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.450491 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvfpq\" (UniqueName: \"kubernetes.io/projected/9dec6f6c-fad8-465d-9602-3449a100598f-kube-api-access-jvfpq\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:43.450555 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:43.450503 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9dec6f6c-fad8-465d-9602-3449a100598f-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:44.179263 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:44.179233 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" Jul 22 12:59:44.179444 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:44.179231 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5xfth" event={"ID":"9dec6f6c-fad8-465d-9602-3449a100598f","Type":"ContainerDied","Data":"56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7"} Jul 22 12:59:44.179444 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:44.179355 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56151a41ebbb85321684f59265dbdf32068e391a51160d6af4bf9dd9fe3da2e7" Jul 22 12:59:46.344246 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:46.344211 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:46.444657 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:46.444629 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:51.783103 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:51.783064 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:51.884347 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:51.884314 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:53.651482 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651449 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t"] Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651773 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="util" Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651785 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="util" Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651799 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="extract" Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651805 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="extract" Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651823 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="pull" Jul 22 12:59:53.651885 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651829 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="pull" Jul 22 12:59:53.652083 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.651899 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dec6f6c-fad8-465d-9602-3449a100598f" containerName="extract" Jul 22 12:59:53.654022 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.654005 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.656865 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.656839 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 22 12:59:53.656999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.656877 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6xmc\"" Jul 22 12:59:53.656999 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.656847 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 22 12:59:53.664388 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.664361 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t"] Jul 22 12:59:53.739290 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.739257 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.739460 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.739310 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.739460 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.739435 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xx6w\" (UniqueName: \"kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.840640 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.840599 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.840806 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.840659 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.840806 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.840739 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xx6w\" (UniqueName: \"kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.841085 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.841062 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.841128 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.841071 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.851170 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.851142 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xx6w\" (UniqueName: \"kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.963254 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.963168 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:53.973383 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:53.973350 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 12:59:54.094919 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:54.094817 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t"] Jul 22 12:59:54.097489 ip-10-0-134-155 kubenswrapper[2549]: W0722 12:59:54.097458 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccec1c4b_949f_4328_b86c_7008d2722cac.slice/crio-4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c WatchSource:0}: Error finding container 4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c: Status 404 returned error can't find the container with id 4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c Jul 22 12:59:54.229575 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:54.229479 2549 generic.go:356] "Generic (PLEG): container finished" podID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerID="7ff8630899372ba4c1f841d0ff8d9646f4e2450f912683e4a3f04a85030a0bd0" exitCode=0 Jul 22 12:59:54.229575 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:54.229553 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" event={"ID":"ccec1c4b-949f-4328-b86c-7008d2722cac","Type":"ContainerDied","Data":"7ff8630899372ba4c1f841d0ff8d9646f4e2450f912683e4a3f04a85030a0bd0"} Jul 22 12:59:54.229757 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:54.229605 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" event={"ID":"ccec1c4b-949f-4328-b86c-7008d2722cac","Type":"ContainerStarted","Data":"4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c"} Jul 22 12:59:55.236693 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:55.236659 2549 generic.go:356] "Generic (PLEG): container finished" podID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerID="230dc394773087b37478ed3bc4783269b5336b45aba076d947e05ab7a0a39802" exitCode=0 Jul 22 12:59:55.237071 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:55.236751 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" event={"ID":"ccec1c4b-949f-4328-b86c-7008d2722cac","Type":"ContainerDied","Data":"230dc394773087b37478ed3bc4783269b5336b45aba076d947e05ab7a0a39802"} Jul 22 12:59:56.244698 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:56.244663 2549 generic.go:356] "Generic (PLEG): container finished" podID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerID="1372ee6dcf685c725ae0e2531b03dae56e01ec62a741d4a4afa74fd64b198d93" exitCode=0 Jul 22 12:59:56.245055 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:56.244753 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" event={"ID":"ccec1c4b-949f-4328-b86c-7008d2722cac","Type":"ContainerDied","Data":"1372ee6dcf685c725ae0e2531b03dae56e01ec62a741d4a4afa74fd64b198d93"} Jul 22 12:59:57.378307 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.378275 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:57.473336 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.473301 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle\") pod \"ccec1c4b-949f-4328-b86c-7008d2722cac\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " Jul 22 12:59:57.473484 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.473363 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util\") pod \"ccec1c4b-949f-4328-b86c-7008d2722cac\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " Jul 22 12:59:57.473484 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.473418 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xx6w\" (UniqueName: \"kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w\") pod \"ccec1c4b-949f-4328-b86c-7008d2722cac\" (UID: \"ccec1c4b-949f-4328-b86c-7008d2722cac\") " Jul 22 12:59:57.474084 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.474064 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle" (OuterVolumeSpecName: "bundle") pod "ccec1c4b-949f-4328-b86c-7008d2722cac" (UID: "ccec1c4b-949f-4328-b86c-7008d2722cac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:57.475447 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.475423 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w" (OuterVolumeSpecName: "kube-api-access-8xx6w") pod "ccec1c4b-949f-4328-b86c-7008d2722cac" (UID: "ccec1c4b-949f-4328-b86c-7008d2722cac"). InnerVolumeSpecName "kube-api-access-8xx6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 12:59:57.481635 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.481610 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util" (OuterVolumeSpecName: "util") pod "ccec1c4b-949f-4328-b86c-7008d2722cac" (UID: "ccec1c4b-949f-4328-b86c-7008d2722cac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 12:59:57.574637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.574596 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:57.574637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.574638 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccec1c4b-949f-4328-b86c-7008d2722cac-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:57.574637 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:57.574648 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xx6w\" (UniqueName: \"kubernetes.io/projected/ccec1c4b-949f-4328-b86c-7008d2722cac-kube-api-access-8xx6w\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 12:59:58.256450 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:58.256414 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" event={"ID":"ccec1c4b-949f-4328-b86c-7008d2722cac","Type":"ContainerDied","Data":"4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c"} Jul 22 12:59:58.256639 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:58.256465 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4669c07c3b94d521ab43747148cb811c1e6dfd76864c57e2afa0997680b6c44c" Jul 22 12:59:58.256639 ip-10-0-134-155 kubenswrapper[2549]: I0722 12:59:58.256488 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhfl8t" Jul 22 12:59:58.292110 ip-10-0-134-155 kubenswrapper[2549]: E0722 12:59:58.292072 2549 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccec1c4b_949f_4328_b86c_7008d2722cac.slice\": RecentStats: unable to find data in memory cache]" Jul 22 13:00:07.779934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:07.779852 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:07.885489 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:07.885452 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:08.315413 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.315381 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:08.529797 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.529760 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:08.641438 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.641350 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:08.672290 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672259 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq"] Jul 22 13:00:08.672659 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672642 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="pull" Jul 22 13:00:08.672756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672661 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="pull" Jul 22 13:00:08.672756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672689 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="extract" Jul 22 13:00:08.672756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672698 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="extract" Jul 22 13:00:08.672756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672715 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="util" Jul 22 13:00:08.672756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672732 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="util" Jul 22 13:00:08.673010 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.672830 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccec1c4b-949f-4328-b86c-7008d2722cac" containerName="extract" Jul 22 13:00:08.677167 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.677148 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.680346 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.680329 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 13:00:08.680470 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.680426 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2qg5c\"" Jul 22 13:00:08.685836 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.685818 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 13:00:08.686084 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.686066 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 13:00:08.686340 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.686325 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 13:00:08.700804 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.700780 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq"] Jul 22 13:00:08.777491 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.777455 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvb2\" (UniqueName: \"kubernetes.io/projected/81a6220c-7939-4a12-88f7-4322be4e66d6-kube-api-access-mfvb2\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.777491 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.777492 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.777750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.777538 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.777750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.777643 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.777750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.777740 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.878490 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878456 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.878925 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878507 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.878925 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878563 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvb2\" (UniqueName: \"kubernetes.io/projected/81a6220c-7939-4a12-88f7-4322be4e66d6-kube-api-access-mfvb2\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.878925 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878581 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.878925 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878602 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.879333 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.878947 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.881003 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.880975 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a6220c-7939-4a12-88f7-4322be4e66d6-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.881108 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.881031 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.881198 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.881174 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a6220c-7939-4a12-88f7-4322be4e66d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.889240 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.889213 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvb2\" (UniqueName: \"kubernetes.io/projected/81a6220c-7939-4a12-88f7-4322be4e66d6-kube-api-access-mfvb2\") pod \"opendatahub-operator-controller-manager-74989f8477-bzgnq\" (UID: \"81a6220c-7939-4a12-88f7-4322be4e66d6\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:08.905554 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.905468 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:08.986269 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:08.986227 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:09.122134 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.122100 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq"] Jul 22 13:00:09.126478 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:09.126453 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a6220c_7939_4a12_88f7_4322be4e66d6.slice/crio-37073f2c147bfdb353fc99d9f87fe7860828f81e96e44ee8323810a2a06a15f4 WatchSource:0}: Error finding container 37073f2c147bfdb353fc99d9f87fe7860828f81e96e44ee8323810a2a06a15f4: Status 404 returned error can't find the container with id 37073f2c147bfdb353fc99d9f87fe7860828f81e96e44ee8323810a2a06a15f4 Jul 22 13:00:09.265537 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.265490 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:09.305763 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.305732 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" event={"ID":"81a6220c-7939-4a12-88f7-4322be4e66d6","Type":"ContainerStarted","Data":"37073f2c147bfdb353fc99d9f87fe7860828f81e96e44ee8323810a2a06a15f4"} Jul 22 13:00:09.363668 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.363631 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:09.465843 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.465807 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:09.566323 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:09.566239 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:12.323659 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:12.323628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" event={"ID":"81a6220c-7939-4a12-88f7-4322be4e66d6","Type":"ContainerStarted","Data":"418f6f6aafbca5937cb5019235b6defb8f83b0be2319105f894c0de220ac197e"} Jul 22 13:00:14.338995 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:14.338960 2549 generic.go:356] "Generic (PLEG): container finished" podID="81a6220c-7939-4a12-88f7-4322be4e66d6" containerID="418f6f6aafbca5937cb5019235b6defb8f83b0be2319105f894c0de220ac197e" exitCode=0 Jul 22 13:00:14.339372 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:14.339031 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" event={"ID":"81a6220c-7939-4a12-88f7-4322be4e66d6","Type":"ContainerDied","Data":"418f6f6aafbca5937cb5019235b6defb8f83b0be2319105f894c0de220ac197e"} Jul 22 13:00:15.345609 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:15.345575 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" event={"ID":"81a6220c-7939-4a12-88f7-4322be4e66d6","Type":"ContainerStarted","Data":"4c5d8ee18e8f8ebf26d8971f1e9c9205aac0f43a04b9aa21a7255fc5f92afc9a"} Jul 22 13:00:15.345975 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:15.345794 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:20.531342 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:20.531302 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:20.659642 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:20.659603 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:23.157564 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:23.157508 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:23.260229 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:23.260193 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:26.352567 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:26.352542 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" Jul 22 13:00:26.394400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:26.394349 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-bzgnq" podStartSLOduration=13.691899564 podStartE2EDuration="18.394333557s" totalImagesPullingTime="3.564246345s" totalInitContainerRuntime="1.138187648s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:15.372953642 +0000 UTC m=+385.259590312" watchObservedRunningTime="2026-07-22 13:00:26.394333557 +0000 UTC m=+396.280970389" Jul 22 13:00:29.259662 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.259627 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:29.393113 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.393080 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:29.914224 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.914193 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2tkdh"] Jul 22 13:00:29.922372 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.922352 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:29.925040 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.925021 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-htps2\"" Jul 22 13:00:29.925355 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.925340 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 22 13:00:29.930958 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.930934 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2tkdh"] Jul 22 13:00:29.949007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.948982 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:29.949151 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.949050 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qg6j\" (UniqueName: \"kubernetes.io/projected/49440fbd-5054-47ec-b63a-84417edee6c1-kube-api-access-4qg6j\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:29.963427 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:29.963396 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:30.049995 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.049961 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qg6j\" (UniqueName: \"kubernetes.io/projected/49440fbd-5054-47ec-b63a-84417edee6c1-kube-api-access-4qg6j\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.050163 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.050055 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.050163 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:00:30.050150 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 22 13:00:30.050249 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:00:30.050209 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert podName:49440fbd-5054-47ec-b63a-84417edee6c1 nodeName:}" failed. No retries permitted until 2026-07-22 13:00:30.550190141 +0000 UTC m=+400.436826787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert") pod "odh-model-controller-7998c67dc4-2tkdh" (UID: "49440fbd-5054-47ec-b63a-84417edee6c1") : secret "odh-model-controller-webhook-cert" not found Jul 22 13:00:30.061866 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.061842 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qg6j\" (UniqueName: \"kubernetes.io/projected/49440fbd-5054-47ec-b63a-84417edee6c1-kube-api-access-4qg6j\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.069699 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.069664 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:30.166369 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.166290 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:30.544769 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.544728 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:30.554408 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.554386 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.556822 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.556794 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49440fbd-5054-47ec-b63a-84417edee6c1-cert\") pod \"odh-model-controller-7998c67dc4-2tkdh\" (UID: \"49440fbd-5054-47ec-b63a-84417edee6c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.590269 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.590244 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w4cwf"] Jul 22 13:00:30.593773 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.593750 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.596286 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.596267 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kqcnf\"" Jul 22 13:00:30.596446 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.596426 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 22 13:00:30.603381 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.603359 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w4cwf"] Jul 22 13:00:30.653691 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.653667 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:30.654779 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.654759 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda77214-6afe-4b53-a8be-08a33f6df1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.654836 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.654792 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6277v\" (UniqueName: \"kubernetes.io/projected/eda77214-6afe-4b53-a8be-08a33f6df1f9-kube-api-access-6277v\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.755956 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.755927 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda77214-6afe-4b53-a8be-08a33f6df1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.756083 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.755967 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6277v\" (UniqueName: \"kubernetes.io/projected/eda77214-6afe-4b53-a8be-08a33f6df1f9-kube-api-access-6277v\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.758338 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.758310 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda77214-6afe-4b53-a8be-08a33f6df1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.770630 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.770607 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6277v\" (UniqueName: \"kubernetes.io/projected/eda77214-6afe-4b53-a8be-08a33f6df1f9-kube-api-access-6277v\") pod \"model-serving-api-54d89bd5fc-w4cwf\" (UID: \"eda77214-6afe-4b53-a8be-08a33f6df1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.833561 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.833497 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:30.907041 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.907006 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:30.982622 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:30.982592 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2tkdh"] Jul 22 13:00:30.983376 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:30.983348 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49440fbd_5054_47ec_b63a_84417edee6c1.slice/crio-13b47e880b98007a178cfee458f95cf2253c3806043410dcd4bad66a0e81aca9 WatchSource:0}: Error finding container 13b47e880b98007a178cfee458f95cf2253c3806043410dcd4bad66a0e81aca9: Status 404 returned error can't find the container with id 13b47e880b98007a178cfee458f95cf2253c3806043410dcd4bad66a0e81aca9 Jul 22 13:00:31.045161 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:31.045035 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w4cwf"] Jul 22 13:00:31.047189 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:31.047165 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda77214_6afe_4b53_a8be_08a33f6df1f9.slice/crio-1e241749f848a3317ef4f081e9ad889a2ea1232e730d97e1245840419d553689 WatchSource:0}: Error finding container 1e241749f848a3317ef4f081e9ad889a2ea1232e730d97e1245840419d553689: Status 404 returned error can't find the container with id 1e241749f848a3317ef4f081e9ad889a2ea1232e730d97e1245840419d553689 Jul 22 13:00:31.423943 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:31.423909 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" event={"ID":"eda77214-6afe-4b53-a8be-08a33f6df1f9","Type":"ContainerStarted","Data":"1e241749f848a3317ef4f081e9ad889a2ea1232e730d97e1245840419d553689"} Jul 22 13:00:31.425103 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:31.425079 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" event={"ID":"49440fbd-5054-47ec-b63a-84417edee6c1","Type":"ContainerStarted","Data":"13b47e880b98007a178cfee458f95cf2253c3806043410dcd4bad66a0e81aca9"} Jul 22 13:00:34.442554 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.442504 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" event={"ID":"49440fbd-5054-47ec-b63a-84417edee6c1","Type":"ContainerStarted","Data":"2099d4fcb3568e113f85f23d96a700fd81634861747455e5a08334b87d89dcf9"} Jul 22 13:00:34.442962 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.442608 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:34.444043 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.444023 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" event={"ID":"eda77214-6afe-4b53-a8be-08a33f6df1f9","Type":"ContainerStarted","Data":"0fb1b5a6ecde05305e309929a55116971a2a55db536fe18aed4f824ddf868403"} Jul 22 13:00:34.444148 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.444071 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:34.460218 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.460163 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" podStartSLOduration=2.211446554 podStartE2EDuration="5.460152309s" totalImagesPullingTime="3.248705755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:34.459240505 +0000 UTC m=+404.345877169" watchObservedRunningTime="2026-07-22 13:00:34.460152309 +0000 UTC m=+404.346788976" Jul 22 13:00:34.483460 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:34.483381 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" podStartSLOduration=1.982161746 podStartE2EDuration="4.483368733s" totalImagesPullingTime="2.501206987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:34.482442849 +0000 UTC m=+404.369079516" watchObservedRunningTime="2026-07-22 13:00:34.483368733 +0000 UTC m=+404.370005399" Jul 22 13:00:38.920988 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.920959 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:38.975588 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.975557 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-526rq"] Jul 22 13:00:38.979212 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.979189 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:38.979979 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.979959 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q"] Jul 22 13:00:38.981755 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.981731 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p9r9p\"" Jul 22 13:00:38.981847 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.981783 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 22 13:00:38.983226 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.983212 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:38.985644 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.985627 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 22 13:00:38.985736 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.985675 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7jnbd\"" Jul 22 13:00:38.999754 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:38.999732 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-526rq"] Jul 22 13:00:39.004371 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.004352 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q"] Jul 22 13:00:39.009049 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.009025 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:39.030012 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.029990 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgl8m\" (UniqueName: \"kubernetes.io/projected/82454252-c2e0-4be2-a17f-006abc732240-kube-api-access-bgl8m\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.030100 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.030044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e81bf4-8de4-4671-b519-8e33364d91cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.030141 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.030121 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.030176 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.030150 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28xd\" (UniqueName: \"kubernetes.io/projected/a6e81bf4-8de4-4671-b519-8e33364d91cf-kube-api-access-s28xd\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.131452 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.131415 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgl8m\" (UniqueName: \"kubernetes.io/projected/82454252-c2e0-4be2-a17f-006abc732240-kube-api-access-bgl8m\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.131668 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.131478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e81bf4-8de4-4671-b519-8e33364d91cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.131668 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.131567 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.131668 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.131605 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28xd\" (UniqueName: \"kubernetes.io/projected/a6e81bf4-8de4-4671-b519-8e33364d91cf-kube-api-access-s28xd\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.131859 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:00:39.131720 2549 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 22 13:00:39.131859 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:00:39.131803 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert podName:82454252-c2e0-4be2-a17f-006abc732240 nodeName:}" failed. No retries permitted until 2026-07-22 13:00:39.631779024 +0000 UTC m=+409.518415670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert") pod "llmisvc-controller-manager-777c6bd7d5-8zl5q" (UID: "82454252-c2e0-4be2-a17f-006abc732240") : secret "llmisvc-webhook-server-cert" not found Jul 22 13:00:39.134314 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.134289 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e81bf4-8de4-4671-b519-8e33364d91cf-cert\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.142555 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.142533 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgl8m\" (UniqueName: \"kubernetes.io/projected/82454252-c2e0-4be2-a17f-006abc732240-kube-api-access-bgl8m\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.143196 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.143178 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28xd\" (UniqueName: \"kubernetes.io/projected/a6e81bf4-8de4-4671-b519-8e33364d91cf-kube-api-access-s28xd\") pod \"kserve-controller-manager-d6f4b65b8-526rq\" (UID: \"a6e81bf4-8de4-4671-b519-8e33364d91cf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.290702 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.290678 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:39.427273 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.427119 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-526rq"] Jul 22 13:00:39.431923 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:39.431894 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e81bf4_8de4_4671_b519_8e33364d91cf.slice/crio-776161e4b7c10308ee9ff8d352995aa7cc50a6b1be2f1f5c0f1c089777802c41 WatchSource:0}: Error finding container 776161e4b7c10308ee9ff8d352995aa7cc50a6b1be2f1f5c0f1c089777802c41: Status 404 returned error can't find the container with id 776161e4b7c10308ee9ff8d352995aa7cc50a6b1be2f1f5c0f1c089777802c41 Jul 22 13:00:39.467324 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.467295 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" event={"ID":"a6e81bf4-8de4-4671-b519-8e33364d91cf","Type":"ContainerStarted","Data":"776161e4b7c10308ee9ff8d352995aa7cc50a6b1be2f1f5c0f1c089777802c41"} Jul 22 13:00:39.637268 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.637179 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.639636 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.639611 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82454252-c2e0-4be2-a17f-006abc732240-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8zl5q\" (UID: \"82454252-c2e0-4be2-a17f-006abc732240\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:39.724632 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.724598 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:39.822167 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.822124 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:39.896414 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:39.896334 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:40.051024 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.050820 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q"] Jul 22 13:00:40.054074 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:40.054044 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod82454252_c2e0_4be2_a17f_006abc732240.slice/crio-464130557fa32a3830bc6d8f97e416007e96e038aab29bb72d7f6801e53816ca WatchSource:0}: Error finding container 464130557fa32a3830bc6d8f97e416007e96e038aab29bb72d7f6801e53816ca: Status 404 returned error can't find the container with id 464130557fa32a3830bc6d8f97e416007e96e038aab29bb72d7f6801e53816ca Jul 22 13:00:40.369494 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.369457 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-767b4d54f8-r974b"] Jul 22 13:00:40.372898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.372882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.375658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.375622 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 13:00:40.375658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.375629 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 13:00:40.375856 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.375663 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zgjth\"" Jul 22 13:00:40.384119 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.384097 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-767b4d54f8-r974b"] Jul 22 13:00:40.446504 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.446469 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tls-certs\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.446687 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.446528 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tmp\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.446687 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.446589 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7fsk\" (UniqueName: \"kubernetes.io/projected/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-kube-api-access-m7fsk\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.474997 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.474957 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" event={"ID":"82454252-c2e0-4be2-a17f-006abc732240","Type":"ContainerStarted","Data":"464130557fa32a3830bc6d8f97e416007e96e038aab29bb72d7f6801e53816ca"} Jul 22 13:00:40.547042 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.547009 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tls-certs\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.547236 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.547048 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tmp\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.547236 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.547073 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7fsk\" (UniqueName: \"kubernetes.io/projected/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-kube-api-access-m7fsk\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.549633 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.549600 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tmp\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.549759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.549704 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-tls-certs\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.559808 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.559783 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7fsk\" (UniqueName: \"kubernetes.io/projected/2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3-kube-api-access-m7fsk\") pod \"kube-auth-proxy-767b4d54f8-r974b\" (UID: \"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3\") " pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.682946 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.682862 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" Jul 22 13:00:40.828805 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.828780 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-767b4d54f8-r974b"] Jul 22 13:00:40.830376 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:40.830344 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cca2a58_35d3_4fd7_b3de_19a14c3f7ef3.slice/crio-605f5b344a84520606f9fd237e4579b9203aa23ef4fafc7ee83a6d9e0a5e979e WatchSource:0}: Error finding container 605f5b344a84520606f9fd237e4579b9203aa23ef4fafc7ee83a6d9e0a5e979e: Status 404 returned error can't find the container with id 605f5b344a84520606f9fd237e4579b9203aa23ef4fafc7ee83a6d9e0a5e979e Jul 22 13:00:40.862225 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.862190 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:40.963227 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:40.963116 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:41.481607 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:41.481573 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" event={"ID":"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3","Type":"ContainerStarted","Data":"605f5b344a84520606f9fd237e4579b9203aa23ef4fafc7ee83a6d9e0a5e979e"} Jul 22 13:00:42.292953 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.292923 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg"] Jul 22 13:00:42.296359 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.296334 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.301007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.300005 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 13:00:42.301007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.300234 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 13:00:42.301007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.300404 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 13:00:42.301007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.300632 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5rq2z\"" Jul 22 13:00:42.301007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.300806 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 13:00:42.315596 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.315568 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg"] Jul 22 13:00:42.363597 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363557 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363612 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363642 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363726 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363764 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363927 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363828 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.363927 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.363907 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqff\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-kube-api-access-xgqff\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464583 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464548 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464745 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464598 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464745 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464665 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464745 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464713 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqff\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-kube-api-access-xgqff\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464765 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464801 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.464923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.464847 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.465500 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.465476 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.467427 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.467402 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.467565 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.467427 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.467565 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.467449 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.467649 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.467566 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.481322 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.481301 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.481541 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.481505 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqff\" (UniqueName: \"kubernetes.io/projected/b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf-kube-api-access-xgqff\") pod \"istiod-openshift-gateway-94bb8fbfd-zmsxg\" (UID: \"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.487989 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.487960 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" event={"ID":"a6e81bf4-8de4-4671-b519-8e33364d91cf","Type":"ContainerStarted","Data":"2966b3677b02632cdd2307a87cdda9f5b2b8c7f13ef6de59cafa3cd564e6246f"} Jul 22 13:00:42.488282 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.488024 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:00:42.516449 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.516411 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" podStartSLOduration=2.271097402 podStartE2EDuration="4.516398509s" totalImagesPullingTime="2.245301107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:42.514159427 +0000 UTC m=+412.400796105" watchObservedRunningTime="2026-07-22 13:00:42.516398509 +0000 UTC m=+412.403035210" Jul 22 13:00:42.609165 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.609088 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:42.747929 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.747827 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg"] Jul 22 13:00:42.750467 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:00:42.750439 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d5cc0d_7b4e_41db_9c69_3fa3a5727eaf.slice/crio-594825a373b0e7b77445c023faa0684614ff2bfd278bab87e5bd74bb69d8d963 WatchSource:0}: Error finding container 594825a373b0e7b77445c023faa0684614ff2bfd278bab87e5bd74bb69d8d963: Status 404 returned error can't find the container with id 594825a373b0e7b77445c023faa0684614ff2bfd278bab87e5bd74bb69d8d963 Jul 22 13:00:42.913229 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.913147 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:42.988975 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:42.988939 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:43.496143 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:43.496100 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" event={"ID":"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf","Type":"ContainerStarted","Data":"594825a373b0e7b77445c023faa0684614ff2bfd278bab87e5bd74bb69d8d963"} Jul 22 13:00:43.587262 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:43.587222 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:45.450710 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:45.450591 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2tkdh" Jul 22 13:00:45.452907 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:45.452885 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-w4cwf" Jul 22 13:00:47.046185 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.046151 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:00:47.046631 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.046212 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 22 13:00:47.522870 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.522834 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" event={"ID":"82454252-c2e0-4be2-a17f-006abc732240","Type":"ContainerStarted","Data":"2f85063c7db8a1b78d8471dd374eae1024c7dea6d4ade213b562ab97daa591f4"} Jul 22 13:00:47.523055 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.522899 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:00:47.524567 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.524543 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" event={"ID":"b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf","Type":"ContainerStarted","Data":"ba2ca1593e1f35555277919cda0ad56c008c61fa5fb1fd266ed924fae26b83ab"} Jul 22 13:00:47.524679 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.524591 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:47.526020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.525999 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" event={"ID":"2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3","Type":"ContainerStarted","Data":"c6f88900e20bbc3675619c1c076c6608e3df6a6ee03f279f86421eb01d5cb5ef"} Jul 22 13:00:47.546458 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.546417 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" podStartSLOduration=2.566914552 podStartE2EDuration="9.54640512s" totalImagesPullingTime="6.979490568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:47.544096811 +0000 UTC m=+417.430733477" watchObservedRunningTime="2026-07-22 13:00:47.54640512 +0000 UTC m=+417.433041787" Jul 22 13:00:47.568854 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.568806 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" podStartSLOduration=1.275228678 podStartE2EDuration="5.568792878s" totalImagesPullingTime="4.2935642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:47.567922714 +0000 UTC m=+417.454559381" watchObservedRunningTime="2026-07-22 13:00:47.568792878 +0000 UTC m=+417.455429545" Jul 22 13:00:47.586318 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.586277 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-767b4d54f8-r974b" podStartSLOduration=1.376099481 podStartE2EDuration="7.586263442s" totalImagesPullingTime="6.210163961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:47.585022091 +0000 UTC m=+417.471658759" watchObservedRunningTime="2026-07-22 13:00:47.586263442 +0000 UTC m=+417.472900109" Jul 22 13:00:47.819270 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.819185 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:47.895271 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:47.895233 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:48.532804 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:48.532774 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-zmsxg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 13:00:48.533217 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:48.532827 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" podUID="b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 13:00:48.661191 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:48.661158 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:48.891586 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:48.891489 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:49.260604 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:49.260560 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:51.531789 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:51.531758 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zmsxg" Jul 22 13:00:53.089373 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:53.089319 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:55.036167 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:55.036129 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:00:55.101853 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:00:55.101820 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:13.501596 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:13.501501 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-526rq" Jul 22 13:01:18.533539 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:18.533488 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8zl5q" Jul 22 13:01:30.736759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:30.736726 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:30.831400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:30.831358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:30.946334 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:30.946301 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:31.669758 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:31.669723 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:31.899029 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:31.898995 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:46.487282 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.487247 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5"] Jul 22 13:01:46.490837 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.490821 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.493645 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.493627 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7hlsk\"" Jul 22 13:01:46.493773 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.493752 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 13:01:46.494924 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.494905 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 13:01:46.501037 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.501017 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5"] Jul 22 13:01:46.632968 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.632934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsklk\" (UniqueName: \"kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.633133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.632992 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.633133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.633059 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.734314 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.734276 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsklk\" (UniqueName: \"kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.734527 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.734489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.734726 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.734698 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.734937 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.734916 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.734986 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.734969 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.744347 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.744293 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsklk\" (UniqueName: \"kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.800275 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.800246 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:46.934393 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:46.934369 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5"] Jul 22 13:01:46.936884 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:01:46.936854 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0b8b0d_4443_4faa_99f0_d814d305d06a.slice/crio-ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153 WatchSource:0}: Error finding container ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153: Status 404 returned error can't find the container with id ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153 Jul 22 13:01:47.089943 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.089911 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2"] Jul 22 13:01:47.093498 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.093482 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.102766 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.102743 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2"] Jul 22 13:01:47.239589 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.239557 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.239802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.239610 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tchhl\" (UniqueName: \"kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.239802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.239702 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.341088 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.341055 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tchhl\" (UniqueName: \"kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.341301 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.341101 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.341301 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.341164 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.341507 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.341490 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.341591 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.341540 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.351110 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.351088 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tchhl\" (UniqueName: \"kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.403800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.403771 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:47.487645 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.487619 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t"] Jul 22 13:01:47.491581 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.491560 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.502251 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.502226 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t"] Jul 22 13:01:47.547884 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.547847 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2"] Jul 22 13:01:47.551532 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:01:47.551495 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4d9ffd_8908_4212_8e99_008d306e815d.slice/crio-da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31 WatchSource:0}: Error finding container da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31: Status 404 returned error can't find the container with id da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31 Jul 22 13:01:47.649821 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.649786 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkchv\" (UniqueName: \"kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.649936 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.649845 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.649936 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.649886 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.751480 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.751439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkchv\" (UniqueName: \"kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.751675 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.751500 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.751675 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.751572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.751898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.751875 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.751972 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.751932 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.760782 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.760755 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkchv\" (UniqueName: \"kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.802196 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.802173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:47.811972 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.811944 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerID="7fc51218225bd4bf6d49cb2f5ef9d05e09e67c850e07eac3c18cffa98dcd1e6d" exitCode=0 Jul 22 13:01:47.812112 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.812042 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" event={"ID":"8c4d9ffd-8908-4212-8e99-008d306e815d","Type":"ContainerDied","Data":"7fc51218225bd4bf6d49cb2f5ef9d05e09e67c850e07eac3c18cffa98dcd1e6d"} Jul 22 13:01:47.812112 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.812103 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" event={"ID":"8c4d9ffd-8908-4212-8e99-008d306e815d","Type":"ContainerStarted","Data":"da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31"} Jul 22 13:01:47.813848 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.813823 2549 generic.go:356] "Generic (PLEG): container finished" podID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerID="7a222e5fc3492b1bbcf718ddb9c323a80e92c8316fea5a8e5c6f1e0ce6cfa314" exitCode=0 Jul 22 13:01:47.813987 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.813897 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" event={"ID":"4c0b8b0d-4443-4faa-99f0-d814d305d06a","Type":"ContainerDied","Data":"7a222e5fc3492b1bbcf718ddb9c323a80e92c8316fea5a8e5c6f1e0ce6cfa314"} Jul 22 13:01:47.813987 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.813945 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" event={"ID":"4c0b8b0d-4443-4faa-99f0-d814d305d06a","Type":"ContainerStarted","Data":"ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153"} Jul 22 13:01:47.893975 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.890169 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88"] Jul 22 13:01:47.911651 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.905170 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:47.911651 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.909229 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88"] Jul 22 13:01:47.958790 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:47.958656 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t"] Jul 22 13:01:47.961420 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:01:47.961395 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f83e83d_7a0f_4f7c_8462_e1b45f1f0f9a.slice/crio-f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132 WatchSource:0}: Error finding container f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132: Status 404 returned error can't find the container with id f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132 Jul 22 13:01:48.054138 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.054107 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.054279 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.054153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5cb\" (UniqueName: \"kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.054279 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.054200 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.155180 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.155104 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.155180 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.155139 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5cb\" (UniqueName: \"kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.155180 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.155180 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.155545 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.155494 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.155618 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.155544 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.166284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.166258 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5cb\" (UniqueName: \"kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.222137 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.222112 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:48.358132 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.358110 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88"] Jul 22 13:01:48.360163 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:01:48.360137 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44165e4f_f5bb_4723_a6e0_5feea5877f7b.slice/crio-adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205 WatchSource:0}: Error finding container adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205: Status 404 returned error can't find the container with id adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205 Jul 22 13:01:48.822319 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.822290 2549 generic.go:356] "Generic (PLEG): container finished" podID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerID="6df34c3d10a9b2e766d0d64ae9c97112b175d28f4d24244c2a9236f1a2fb9dbe" exitCode=0 Jul 22 13:01:48.822689 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.822366 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" event={"ID":"4c0b8b0d-4443-4faa-99f0-d814d305d06a","Type":"ContainerDied","Data":"6df34c3d10a9b2e766d0d64ae9c97112b175d28f4d24244c2a9236f1a2fb9dbe"} Jul 22 13:01:48.823955 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.823930 2549 generic.go:356] "Generic (PLEG): container finished" podID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerID="a2b194b0d8a1c2694367aee86000039a1bbceaa0fc8614e18e93bfdabfefc78e" exitCode=0 Jul 22 13:01:48.824076 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.823962 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerDied","Data":"a2b194b0d8a1c2694367aee86000039a1bbceaa0fc8614e18e93bfdabfefc78e"} Jul 22 13:01:48.824076 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.824012 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerStarted","Data":"adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205"} Jul 22 13:01:48.825426 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.825407 2549 generic.go:356] "Generic (PLEG): container finished" podID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerID="1ce964275625c4f23fe302c2ef1585bbec09c72de74f41693c5bae808ac28570" exitCode=0 Jul 22 13:01:48.825535 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.825478 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" event={"ID":"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a","Type":"ContainerDied","Data":"1ce964275625c4f23fe302c2ef1585bbec09c72de74f41693c5bae808ac28570"} Jul 22 13:01:48.825587 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:48.825539 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" event={"ID":"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a","Type":"ContainerStarted","Data":"f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132"} Jul 22 13:01:49.833786 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:49.833756 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerID="eacbfdfda65929605080888a451ef443c801e4130ce47d7f640ecb84ed66e6d2" exitCode=0 Jul 22 13:01:49.834144 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:49.833835 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" event={"ID":"8c4d9ffd-8908-4212-8e99-008d306e815d","Type":"ContainerDied","Data":"eacbfdfda65929605080888a451ef443c801e4130ce47d7f640ecb84ed66e6d2"} Jul 22 13:01:49.836123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:49.836098 2549 generic.go:356] "Generic (PLEG): container finished" podID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerID="e0d6a70ad725780b648d0e50688ee9a34a3c48d4c3dec7f8f00886da8fea975e" exitCode=0 Jul 22 13:01:49.836232 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:49.836136 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" event={"ID":"4c0b8b0d-4443-4faa-99f0-d814d305d06a","Type":"ContainerDied","Data":"e0d6a70ad725780b648d0e50688ee9a34a3c48d4c3dec7f8f00886da8fea975e"} Jul 22 13:01:49.838452 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:49.838424 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerStarted","Data":"9e00f619954fb20fadbfd87bca8dd87e4b81eb4444b7ae9de448036437165e73"} Jul 22 13:01:50.844720 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.844678 2549 generic.go:356] "Generic (PLEG): container finished" podID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerID="9e00f619954fb20fadbfd87bca8dd87e4b81eb4444b7ae9de448036437165e73" exitCode=0 Jul 22 13:01:50.845161 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.844762 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerDied","Data":"9e00f619954fb20fadbfd87bca8dd87e4b81eb4444b7ae9de448036437165e73"} Jul 22 13:01:50.846689 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.846666 2549 generic.go:356] "Generic (PLEG): container finished" podID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerID="816b8d8423f9840b867239ce378a529e049fde2ced826f05f55d864b85c589cf" exitCode=0 Jul 22 13:01:50.846777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.846705 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" event={"ID":"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a","Type":"ContainerDied","Data":"816b8d8423f9840b867239ce378a529e049fde2ced826f05f55d864b85c589cf"} Jul 22 13:01:50.849010 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.848991 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerID="19577ad9e0a3e7343b843b4b6d8ae5d1debacaaabb0e4b3950b19c19a8f11880" exitCode=0 Jul 22 13:01:50.849098 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.849071 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" event={"ID":"8c4d9ffd-8908-4212-8e99-008d306e815d","Type":"ContainerDied","Data":"19577ad9e0a3e7343b843b4b6d8ae5d1debacaaabb0e4b3950b19c19a8f11880"} Jul 22 13:01:50.995322 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:50.995299 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:51.184540 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.184431 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsklk\" (UniqueName: \"kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk\") pod \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " Jul 22 13:01:51.184540 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.184476 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle\") pod \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " Jul 22 13:01:51.184540 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.184501 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util\") pod \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\" (UID: \"4c0b8b0d-4443-4faa-99f0-d814d305d06a\") " Jul 22 13:01:51.184940 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.184916 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle" (OuterVolumeSpecName: "bundle") pod "4c0b8b0d-4443-4faa-99f0-d814d305d06a" (UID: "4c0b8b0d-4443-4faa-99f0-d814d305d06a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:51.186776 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.186746 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk" (OuterVolumeSpecName: "kube-api-access-zsklk") pod "4c0b8b0d-4443-4faa-99f0-d814d305d06a" (UID: "4c0b8b0d-4443-4faa-99f0-d814d305d06a"). InnerVolumeSpecName "kube-api-access-zsklk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:01:51.190218 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.190194 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util" (OuterVolumeSpecName: "util") pod "4c0b8b0d-4443-4faa-99f0-d814d305d06a" (UID: "4c0b8b0d-4443-4faa-99f0-d814d305d06a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:51.285742 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.285707 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsklk\" (UniqueName: \"kubernetes.io/projected/4c0b8b0d-4443-4faa-99f0-d814d305d06a-kube-api-access-zsklk\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:51.285742 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.285737 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:51.285742 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.285748 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c0b8b0d-4443-4faa-99f0-d814d305d06a-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:51.856118 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.856096 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" Jul 22 13:01:51.856491 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.856086 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5" event={"ID":"4c0b8b0d-4443-4faa-99f0-d814d305d06a","Type":"ContainerDied","Data":"ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153"} Jul 22 13:01:51.856491 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.856206 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec860a436e73dbb9a0e12805d6743c0cd85bd954d6dc39d15bea9d79c2812153" Jul 22 13:01:51.858360 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.858332 2549 generic.go:356] "Generic (PLEG): container finished" podID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerID="c9669966e4073f97a1fc3a3a4b6a31082a42bf8050f40f8417491b895fc025ff" exitCode=0 Jul 22 13:01:51.858507 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.858416 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerDied","Data":"c9669966e4073f97a1fc3a3a4b6a31082a42bf8050f40f8417491b895fc025ff"} Jul 22 13:01:51.860455 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.860432 2549 generic.go:356] "Generic (PLEG): container finished" podID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerID="2340ba7c39c3015989e54d1844f23fc4a36cf2478ee7aef6548ce3175040cce4" exitCode=0 Jul 22 13:01:51.860561 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.860543 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" event={"ID":"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a","Type":"ContainerDied","Data":"2340ba7c39c3015989e54d1844f23fc4a36cf2478ee7aef6548ce3175040cce4"} Jul 22 13:01:51.994258 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:51.994236 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:52.192136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.192102 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util\") pod \"8c4d9ffd-8908-4212-8e99-008d306e815d\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " Jul 22 13:01:52.192296 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.192150 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle\") pod \"8c4d9ffd-8908-4212-8e99-008d306e815d\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " Jul 22 13:01:52.192296 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.192204 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tchhl\" (UniqueName: \"kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl\") pod \"8c4d9ffd-8908-4212-8e99-008d306e815d\" (UID: \"8c4d9ffd-8908-4212-8e99-008d306e815d\") " Jul 22 13:01:52.192795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.192764 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle" (OuterVolumeSpecName: "bundle") pod "8c4d9ffd-8908-4212-8e99-008d306e815d" (UID: "8c4d9ffd-8908-4212-8e99-008d306e815d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:52.194430 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.194400 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl" (OuterVolumeSpecName: "kube-api-access-tchhl") pod "8c4d9ffd-8908-4212-8e99-008d306e815d" (UID: "8c4d9ffd-8908-4212-8e99-008d306e815d"). InnerVolumeSpecName "kube-api-access-tchhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:01:52.197802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.197772 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util" (OuterVolumeSpecName: "util") pod "8c4d9ffd-8908-4212-8e99-008d306e815d" (UID: "8c4d9ffd-8908-4212-8e99-008d306e815d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:52.293594 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.293566 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:52.293594 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.293591 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c4d9ffd-8908-4212-8e99-008d306e815d-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:52.293594 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.293600 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tchhl\" (UniqueName: \"kubernetes.io/projected/8c4d9ffd-8908-4212-8e99-008d306e815d-kube-api-access-tchhl\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:52.867214 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.867132 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" Jul 22 13:01:52.867214 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.867154 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2" event={"ID":"8c4d9ffd-8908-4212-8e99-008d306e815d","Type":"ContainerDied","Data":"da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31"} Jul 22 13:01:52.867617 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:52.867224 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da9c0ee042b41e761ff775c7cea70cb68fa65f61ca53441cff7c0610c8183d31" Jul 22 13:01:53.004614 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.004587 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:53.027746 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.027712 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:53.100052 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100015 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util\") pod \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " Jul 22 13:01:53.100221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100063 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkchv\" (UniqueName: \"kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv\") pod \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " Jul 22 13:01:53.100221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100097 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util\") pod \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " Jul 22 13:01:53.100221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100112 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt5cb\" (UniqueName: \"kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb\") pod \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " Jul 22 13:01:53.100221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100176 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle\") pod \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\" (UID: \"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a\") " Jul 22 13:01:53.100449 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100340 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle\") pod \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\" (UID: \"44165e4f-f5bb-4723-a6e0-5feea5877f7b\") " Jul 22 13:01:53.100934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.100895 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle" (OuterVolumeSpecName: "bundle") pod "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" (UID: "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:53.101102 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.101080 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle" (OuterVolumeSpecName: "bundle") pod "44165e4f-f5bb-4723-a6e0-5feea5877f7b" (UID: "44165e4f-f5bb-4723-a6e0-5feea5877f7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:53.102827 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.102799 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv" (OuterVolumeSpecName: "kube-api-access-xkchv") pod "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" (UID: "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a"). InnerVolumeSpecName "kube-api-access-xkchv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:01:53.102927 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.102826 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb" (OuterVolumeSpecName: "kube-api-access-qt5cb") pod "44165e4f-f5bb-4723-a6e0-5feea5877f7b" (UID: "44165e4f-f5bb-4723-a6e0-5feea5877f7b"). InnerVolumeSpecName "kube-api-access-qt5cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:01:53.105878 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.105846 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util" (OuterVolumeSpecName: "util") pod "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" (UID: "2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:53.106114 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.106097 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util" (OuterVolumeSpecName: "util") pod "44165e4f-f5bb-4723-a6e0-5feea5877f7b" (UID: "44165e4f-f5bb-4723-a6e0-5feea5877f7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201854 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201897 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkchv\" (UniqueName: \"kubernetes.io/projected/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-kube-api-access-xkchv\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201908 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-util\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201916 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt5cb\" (UniqueName: \"kubernetes.io/projected/44165e4f-f5bb-4723-a6e0-5feea5877f7b-kube-api-access-qt5cb\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201925 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.201952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.201933 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44165e4f-f5bb-4723-a6e0-5feea5877f7b-bundle\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:01:53.874949 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.874912 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" event={"ID":"44165e4f-f5bb-4723-a6e0-5feea5877f7b","Type":"ContainerDied","Data":"adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205"} Jul 22 13:01:53.875383 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.874969 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adeab484bf88de7cb3dca53361f28c8d595f7cd058f7d266268a2125f78f3205" Jul 22 13:01:53.875383 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.874922 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88" Jul 22 13:01:53.876695 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.876670 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" event={"ID":"2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a","Type":"ContainerDied","Data":"f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132"} Jul 22 13:01:53.876695 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.876685 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t" Jul 22 13:01:53.876843 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:53.876705 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f17b735890553812422641ec9ef93ac9dea9be612b857e8092f076cc1f9c9132" Jul 22 13:01:54.252812 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:54.252735 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:54.348032 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:54.348001 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:54.410885 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:54.410849 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:54.977993 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:54.977962 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:55.053312 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:55.053276 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:59.181638 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:59.181600 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:01:59.718604 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:01:59.718572 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:00.387049 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:00.387009 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:05.008122 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:05.008087 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:05.186407 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:05.186363 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:05.310949 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:05.310855 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:06.866091 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866054 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb"] Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866409 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866419 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866431 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866437 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866451 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866458 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="util" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866463 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="extract" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866469 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="extract" Jul 22 13:02:06.866476 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866479 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866485 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866493 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866498 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866505 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866510 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866534 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="util" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866540 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="util" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866545 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866550 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866556 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866562 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866569 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866573 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866582 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866587 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="pull" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866642 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c4d9ffd-8908-4212-8e99-008d306e815d" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866652 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866657 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="44165e4f-f5bb-4723-a6e0-5feea5877f7b" containerName="extract" Jul 22 13:02:06.866777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.866663 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0b8b0d-4443-4faa-99f0-d814d305d06a" containerName="extract" Jul 22 13:02:06.870935 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.870918 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:06.873728 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.873708 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 13:02:06.873728 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.873722 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 13:02:06.875040 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.875020 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bxjx2\"" Jul 22 13:02:06.889505 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.889483 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb"] Jul 22 13:02:06.930364 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:06.930336 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqd7f\" (UniqueName: \"kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f\") pod \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" (UID: \"ce10da60-a15a-469c-977b-1f6ac7a164c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:07.030801 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.030772 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqd7f\" (UniqueName: \"kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f\") pod \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" (UID: \"ce10da60-a15a-469c-977b-1f6ac7a164c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:07.044712 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.044681 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqd7f\" (UniqueName: \"kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f\") pod \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" (UID: \"ce10da60-a15a-469c-977b-1f6ac7a164c6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:07.180606 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.180497 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:07.334856 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.334832 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb"] Jul 22 13:02:07.336531 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:02:07.336489 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce10da60_a15a_469c_977b_1f6ac7a164c6.slice/crio-5e341bf4df9344355c68292b4815d31c03a128bab2c884bb4bc129abcb430637 WatchSource:0}: Error finding container 5e341bf4df9344355c68292b4815d31c03a128bab2c884bb4bc129abcb430637: Status 404 returned error can't find the container with id 5e341bf4df9344355c68292b4815d31c03a128bab2c884bb4bc129abcb430637 Jul 22 13:02:07.950291 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.950260 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" event={"ID":"ce10da60-a15a-469c-977b-1f6ac7a164c6","Type":"ContainerStarted","Data":"5e341bf4df9344355c68292b4815d31c03a128bab2c884bb4bc129abcb430637"} Jul 22 13:02:07.981746 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:07.981718 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:08.125957 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:08.125930 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:09.322393 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:09.322317 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:09.697211 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:09.697124 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:10.967046 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:10.967007 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" event={"ID":"ce10da60-a15a-469c-977b-1f6ac7a164c6","Type":"ContainerStarted","Data":"d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269"} Jul 22 13:02:10.967509 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:10.967146 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:10.979067 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:10.979038 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:10.994811 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:10.994764 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" podStartSLOduration=2.007207132 podStartE2EDuration="4.994749784s" totalImagesPullingTime="2.987542652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:10.992595159 +0000 UTC m=+500.879231828" watchObservedRunningTime="2026-07-22 13:02:10.994749784 +0000 UTC m=+500.881386525" Jul 22 13:02:12.750742 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:12.750709 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:13.375178 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:13.375134 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:15.747038 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:15.746995 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:15.840338 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:15.840306 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:16.193854 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:16.193821 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:16.287442 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:16.287407 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:17.532180 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:17.532149 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:17.610582 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:17.610489 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:19.584800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:19.584770 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:19.761228 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:19.761192 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:20.688237 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:20.688205 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:21.088844 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:21.088808 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:21.974739 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:21.974714 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:22.775533 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:22.775475 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:22.917591 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:22.917556 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:29.372208 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:29.372174 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:29.485300 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:29.485261 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:30.807832 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.807789 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4"] Jul 22 13:02:30.814480 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.814457 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:30.818134 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.818119 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2lfdr\"" Jul 22 13:02:30.828538 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.828495 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4"] Jul 22 13:02:30.949647 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.949612 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlmb\" (UniqueName: \"kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:30.949836 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:30.949748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.050499 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.050466 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlmb\" (UniqueName: \"kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.050718 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.050572 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.050937 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.050917 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.069555 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.069463 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlmb\" (UniqueName: \"kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb\") pod \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.124074 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.124044 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.183115 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.183083 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4"] Jul 22 13:02:31.188320 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.188268 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4"] Jul 22 13:02:31.220248 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.220174 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:02:31.224686 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.224660 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.225626 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.225601 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb"] Jul 22 13:02:31.225847 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.225791 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" containerName="manager" containerID="cri-o://d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269" gracePeriod=2 Jul 22 13:02:31.244261 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.244195 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb"] Jul 22 13:02:31.248183 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.248158 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:02:31.263340 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.263316 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp"] Jul 22 13:02:31.263713 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.263700 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" containerName="manager" Jul 22 13:02:31.263771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.263716 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" containerName="manager" Jul 22 13:02:31.263809 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.263798 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" containerName="manager" Jul 22 13:02:31.265941 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:31.265901 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:31.266978 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.266955 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:31.269180 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:31.269148 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:31.294636 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.294605 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp"] Jul 22 13:02:31.353724 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.353691 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpld\" (UniqueName: \"kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.353906 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.353739 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.407645 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:31.407599 2549 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 22 13:02:31.407645 ip-10-0-134-155 kubenswrapper[2549]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-spxc4_kuadrant-system_1f4aa909-03c2-4cb6-bf22-d829616b4699_0(0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-spxc4 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758" Netns:"/var/run/netns/c84f3ff0-78a3-4a1d-93ab-c1fb41567aa0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-spxc4;K8S_POD_INFRA_CONTAINER_ID=0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758;K8S_POD_UID=1f4aa909-03c2-4cb6-bf22-d829616b4699" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4/1f4aa909-03c2-4cb6-bf22-d829616b4699:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4 0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4 0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2c [10.132.0.44/23] Jul 22 13:02:31.407645 ip-10-0-134-155 kubenswrapper[2549]: ' Jul 22 13:02:31.407645 ip-10-0-134-155 kubenswrapper[2549]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 22 13:02:31.407645 ip-10-0-134-155 kubenswrapper[2549]: > Jul 22 13:02:31.407997 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:31.407670 2549 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 22 13:02:31.407997 ip-10-0-134-155 kubenswrapper[2549]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-spxc4_kuadrant-system_1f4aa909-03c2-4cb6-bf22-d829616b4699_0(0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-spxc4 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758" Netns:"/var/run/netns/c84f3ff0-78a3-4a1d-93ab-c1fb41567aa0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-spxc4;K8S_POD_INFRA_CONTAINER_ID=0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758;K8S_POD_UID=1f4aa909-03c2-4cb6-bf22-d829616b4699" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4/1f4aa909-03c2-4cb6-bf22-d829616b4699:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4 0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4 0fe94f85e0378e5663f917f784fe800d7dc691b5dd6ec44fb9148bbb365cf758 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:2c [10.132.0.44/23] Jul 22 13:02:31.407997 ip-10-0-134-155 kubenswrapper[2549]: ' Jul 22 13:02:31.407997 ip-10-0-134-155 kubenswrapper[2549]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 22 13:02:31.407997 ip-10-0-134-155 kubenswrapper[2549]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:31.454406 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.454382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpld\" (UniqueName: \"kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.454556 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.454419 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv8j5\" (UniqueName: \"kubernetes.io/projected/528a7cff-612a-4d82-b94f-6cc4a783fcd5-kube-api-access-hv8j5\") pod \"limitador-operator-controller-manager-859d7b78bd-8n9kp\" (UID: \"528a7cff-612a-4d82-b94f-6cc4a783fcd5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:31.454556 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.454447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.454835 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.454817 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.460955 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.460924 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:31.464965 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:31.464938 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:31.465714 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.465693 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpld\" (UniqueName: \"kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld\") pod \"kuadrant-operator-controller-manager-55467d9f7-q8vwj\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.555325 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.555296 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqd7f\" (UniqueName: \"kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f\") pod \"ce10da60-a15a-469c-977b-1f6ac7a164c6\" (UID: \"ce10da60-a15a-469c-977b-1f6ac7a164c6\") " Jul 22 13:02:31.555462 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.555450 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv8j5\" (UniqueName: \"kubernetes.io/projected/528a7cff-612a-4d82-b94f-6cc4a783fcd5-kube-api-access-hv8j5\") pod \"limitador-operator-controller-manager-859d7b78bd-8n9kp\" (UID: \"528a7cff-612a-4d82-b94f-6cc4a783fcd5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:31.557268 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.557246 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f" (OuterVolumeSpecName: "kube-api-access-pqd7f") pod "ce10da60-a15a-469c-977b-1f6ac7a164c6" (UID: "ce10da60-a15a-469c-977b-1f6ac7a164c6"). InnerVolumeSpecName "kube-api-access-pqd7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:02:31.569292 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.569261 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv8j5\" (UniqueName: \"kubernetes.io/projected/528a7cff-612a-4d82-b94f-6cc4a783fcd5-kube-api-access-hv8j5\") pod \"limitador-operator-controller-manager-859d7b78bd-8n9kp\" (UID: \"528a7cff-612a-4d82-b94f-6cc4a783fcd5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:31.599750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.599675 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:31.614151 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.614129 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:31.657056 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.657029 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqd7f\" (UniqueName: \"kubernetes.io/projected/ce10da60-a15a-469c-977b-1f6ac7a164c6-kube-api-access-pqd7f\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:02:31.748983 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.748958 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:02:31.751567 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:02:31.751542 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21da9fd_a199_4025_ad3e_62794a67735c.slice/crio-db0b70d2bbd906ccb5b420537ee9ba4578b74c79821197f075b3290afd8fbbe2 WatchSource:0}: Error finding container db0b70d2bbd906ccb5b420537ee9ba4578b74c79821197f075b3290afd8fbbe2: Status 404 returned error can't find the container with id db0b70d2bbd906ccb5b420537ee9ba4578b74c79821197f075b3290afd8fbbe2 Jul 22 13:02:31.763927 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:31.763908 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp"] Jul 22 13:02:31.765536 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:02:31.765494 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528a7cff_612a_4d82_b94f_6cc4a783fcd5.slice/crio-0f7f652866bb9de6fcaeac215a33c023b86f9941971784962e1557228edd32c7 WatchSource:0}: Error finding container 0f7f652866bb9de6fcaeac215a33c023b86f9941971784962e1557228edd32c7: Status 404 returned error can't find the container with id 0f7f652866bb9de6fcaeac215a33c023b86f9941971784962e1557228edd32c7 Jul 22 13:02:32.073777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.073742 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" event={"ID":"e21da9fd-a199-4025-ad3e-62794a67735c","Type":"ContainerStarted","Data":"db0b70d2bbd906ccb5b420537ee9ba4578b74c79821197f075b3290afd8fbbe2"} Jul 22 13:02:32.075146 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.075116 2549 generic.go:356] "Generic (PLEG): container finished" podID="ce10da60-a15a-469c-977b-1f6ac7a164c6" containerID="d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269" exitCode=0 Jul 22 13:02:32.075269 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.075169 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:32.075269 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.075208 2549 scope.go:117] "RemoveContainer" containerID="d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269" Jul 22 13:02:32.077115 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.077091 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" event={"ID":"528a7cff-612a-4d82-b94f-6cc4a783fcd5","Type":"ContainerStarted","Data":"21ddbeb3ac601f1e86d936f2d6d3141806b375f09b871af4097e412998b3daa1"} Jul 22 13:02:32.077248 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.077147 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:32.077248 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.077167 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:32.077248 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.077202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" event={"ID":"528a7cff-612a-4d82-b94f-6cc4a783fcd5","Type":"ContainerStarted","Data":"0f7f652866bb9de6fcaeac215a33c023b86f9941971784962e1557228edd32c7"} Jul 22 13:02:32.077976 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.077945 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:32.080140 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.080112 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:32.092647 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.092630 2549 scope.go:117] "RemoveContainer" containerID="d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269" Jul 22 13:02:32.092898 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.092873 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269\": container with ID starting with d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269 not found: ID does not exist" containerID="d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269" Jul 22 13:02:32.092996 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.092903 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269"} err="failed to get container status \"d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269\": rpc error: code = NotFound desc = could not find container \"d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269\": container with ID starting with d15ef17016256412c9f00f95832bacb30568d5ac356ae3339f8cbbaf1bc8b269 not found: ID does not exist" Jul 22 13:02:32.096690 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.096671 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:32.100592 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.100567 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="1f4aa909-03c2-4cb6-bf22-d829616b4699" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:32.100888 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.100852 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" podStartSLOduration=1.100838949 podStartE2EDuration="1.100838949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:32.098458204 +0000 UTC m=+521.985094871" watchObservedRunningTime="2026-07-22 13:02:32.100838949 +0000 UTC m=+521.987475618" Jul 22 13:02:32.102691 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.102667 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="1f4aa909-03c2-4cb6-bf22-d829616b4699" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:32.104659 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:32.104638 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f7vmb\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f7vmb" Jul 22 13:02:32.262368 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.262335 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume\") pod \"1f4aa909-03c2-4cb6-bf22-d829616b4699\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " Jul 22 13:02:32.262544 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.262382 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vlmb\" (UniqueName: \"kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb\") pod \"1f4aa909-03c2-4cb6-bf22-d829616b4699\" (UID: \"1f4aa909-03c2-4cb6-bf22-d829616b4699\") " Jul 22 13:02:32.262622 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.262602 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1f4aa909-03c2-4cb6-bf22-d829616b4699" (UID: "1f4aa909-03c2-4cb6-bf22-d829616b4699"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:02:32.262752 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.262735 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f4aa909-03c2-4cb6-bf22-d829616b4699-extensions-socket-volume\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:02:32.264296 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.264272 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb" (OuterVolumeSpecName: "kube-api-access-2vlmb") pod "1f4aa909-03c2-4cb6-bf22-d829616b4699" (UID: "1f4aa909-03c2-4cb6-bf22-d829616b4699"). InnerVolumeSpecName "kube-api-access-2vlmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:02:32.363766 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.363689 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vlmb\" (UniqueName: \"kubernetes.io/projected/1f4aa909-03c2-4cb6-bf22-d829616b4699-kube-api-access-2vlmb\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:02:32.557822 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.557788 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4aa909-03c2-4cb6-bf22-d829616b4699" path="/var/lib/kubelet/pods/1f4aa909-03c2-4cb6-bf22-d829616b4699/volumes" Jul 22 13:02:32.558137 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:32.558121 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce10da60-a15a-469c-977b-1f6ac7a164c6" path="/var/lib/kubelet/pods/ce10da60-a15a-469c-977b-1f6ac7a164c6/volumes" Jul 22 13:02:33.082849 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:33.082825 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:33.087611 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:02:33.087582 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-spxc4\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="1f4aa909-03c2-4cb6-bf22-d829616b4699" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-spxc4" Jul 22 13:02:35.035784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:35.035739 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:35.132806 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:35.132766 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:35.600408 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:35.600375 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:35.671123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:35.671087 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:37.107024 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:37.106990 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" event={"ID":"e21da9fd-a199-4025-ad3e-62794a67735c","Type":"ContainerStarted","Data":"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf"} Jul 22 13:02:37.107424 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:37.107079 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:37.134012 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:37.133961 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" podStartSLOduration=1.277318421 podStartE2EDuration="6.13394624s" totalImagesPullingTime="4.856627819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:37.130699423 +0000 UTC m=+527.017336089" watchObservedRunningTime="2026-07-22 13:02:37.13394624 +0000 UTC m=+527.020582907" Jul 22 13:02:39.406400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:39.406368 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:39.506795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:39.506761 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:42.816269 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:42.816183 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:42.917192 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:42.917160 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:43.085140 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:43.085066 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8n9kp" Jul 22 13:02:48.114590 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:48.114557 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:02:48.337065 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:48.337027 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:02:48.434918 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:02:48.434887 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:00.434214 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.434178 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:03:00.434664 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.434376 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" podUID="e21da9fd-a199-4025-ad3e-62794a67735c" containerName="manager" containerID="cri-o://5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf" gracePeriod=10 Jul 22 13:03:00.681436 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.681413 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:03:00.818051 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.818016 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume\") pod \"e21da9fd-a199-4025-ad3e-62794a67735c\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " Jul 22 13:03:00.818240 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.818103 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrpld\" (UniqueName: \"kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld\") pod \"e21da9fd-a199-4025-ad3e-62794a67735c\" (UID: \"e21da9fd-a199-4025-ad3e-62794a67735c\") " Jul 22 13:03:00.818401 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.818375 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e21da9fd-a199-4025-ad3e-62794a67735c" (UID: "e21da9fd-a199-4025-ad3e-62794a67735c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 13:03:00.820216 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.820192 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld" (OuterVolumeSpecName: "kube-api-access-jrpld") pod "e21da9fd-a199-4025-ad3e-62794a67735c" (UID: "e21da9fd-a199-4025-ad3e-62794a67735c"). InnerVolumeSpecName "kube-api-access-jrpld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:03:00.919136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.919103 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrpld\" (UniqueName: \"kubernetes.io/projected/e21da9fd-a199-4025-ad3e-62794a67735c-kube-api-access-jrpld\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:03:00.919136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:00.919129 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e21da9fd-a199-4025-ad3e-62794a67735c-extensions-socket-volume\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:03:01.234886 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.234792 2549 generic.go:356] "Generic (PLEG): container finished" podID="e21da9fd-a199-4025-ad3e-62794a67735c" containerID="5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf" exitCode=0 Jul 22 13:03:01.234886 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.234844 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" Jul 22 13:03:01.235110 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.234879 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" event={"ID":"e21da9fd-a199-4025-ad3e-62794a67735c","Type":"ContainerDied","Data":"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf"} Jul 22 13:03:01.235110 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.234936 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj" event={"ID":"e21da9fd-a199-4025-ad3e-62794a67735c","Type":"ContainerDied","Data":"db0b70d2bbd906ccb5b420537ee9ba4578b74c79821197f075b3290afd8fbbe2"} Jul 22 13:03:01.235110 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.234958 2549 scope.go:117] "RemoveContainer" containerID="5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf" Jul 22 13:03:01.244008 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.243992 2549 scope.go:117] "RemoveContainer" containerID="5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf" Jul 22 13:03:01.244261 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:03:01.244243 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf\": container with ID starting with 5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf not found: ID does not exist" containerID="5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf" Jul 22 13:03:01.244331 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.244270 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf"} err="failed to get container status \"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf\": rpc error: code = NotFound desc = could not find container \"5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf\": container with ID starting with 5e9bf7ca1a589d56c4512ebd19b1a5f00d3712282541b05d93069d409ffbbdcf not found: ID does not exist" Jul 22 13:03:01.261786 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.261756 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:03:01.268414 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.268388 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q8vwj"] Jul 22 13:03:01.491784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.491696 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:01.571757 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:01.571729 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:02.554979 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:02.554950 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21da9fd-a199-4025-ad3e-62794a67735c" path="/var/lib/kubelet/pods/e21da9fd-a199-4025-ad3e-62794a67735c/volumes" Jul 22 13:03:04.927176 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:04.927136 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:05.241138 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:05.241043 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:07.216993 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.216937 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:07.217400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.217380 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21da9fd-a199-4025-ad3e-62794a67735c" containerName="manager" Jul 22 13:03:07.217400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.217394 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21da9fd-a199-4025-ad3e-62794a67735c" containerName="manager" Jul 22 13:03:07.217471 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.217466 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21da9fd-a199-4025-ad3e-62794a67735c" containerName="manager" Jul 22 13:03:07.222182 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.222165 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.226502 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.226485 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7hlsk\"" Jul 22 13:03:07.226849 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.226835 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 13:03:07.242264 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.242238 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:07.285246 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.285208 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:07.313732 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.313701 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:07.371646 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.371611 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95kjc\" (UniqueName: \"kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.371813 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.371734 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.442337 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.442302 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:07.472960 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.472877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.472960 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.472937 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95kjc\" (UniqueName: \"kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.473620 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.473595 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.506003 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.505974 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95kjc\" (UniqueName: \"kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc\") pod \"limitador-limitador-64c94fd64f-5gqlp\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.531955 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.531923 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:07.682670 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:07.682647 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:07.684543 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:03:07.684502 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1e5b12_f507_4f4e_a5b0_1394d6f6ca17.slice/crio-c3d28cafeb372ae2ec3e22268f7384213c6678d444c51a4f96a1bb8a2c7e8771 WatchSource:0}: Error finding container c3d28cafeb372ae2ec3e22268f7384213c6678d444c51a4f96a1bb8a2c7e8771: Status 404 returned error can't find the container with id c3d28cafeb372ae2ec3e22268f7384213c6678d444c51a4f96a1bb8a2c7e8771 Jul 22 13:03:08.227330 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:08.227297 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:08.274444 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:08.274411 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" event={"ID":"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17","Type":"ContainerStarted","Data":"c3d28cafeb372ae2ec3e22268f7384213c6678d444c51a4f96a1bb8a2c7e8771"} Jul 22 13:03:08.324592 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:08.324553 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:11.296283 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:11.296248 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" event={"ID":"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17","Type":"ContainerStarted","Data":"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3"} Jul 22 13:03:11.296690 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:11.296362 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:11.326292 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:11.326240 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" podStartSLOduration=1.033216478 podStartE2EDuration="4.326225017s" totalImagesPullingTime="3.293008539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:11.325867262 +0000 UTC m=+561.212503929" watchObservedRunningTime="2026-07-22 13:03:11.326225017 +0000 UTC m=+561.212861683" Jul 22 13:03:22.303469 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:22.303433 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:27.025740 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.025703 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:27.026192 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.025941 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" podUID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" containerName="limitador" containerID="cri-o://5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3" gracePeriod=30 Jul 22 13:03:27.571063 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.571039 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:27.649117 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.649038 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file\") pod \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " Jul 22 13:03:27.649263 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.649120 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95kjc\" (UniqueName: \"kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc\") pod \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\" (UID: \"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17\") " Jul 22 13:03:27.649456 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.649430 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file" (OuterVolumeSpecName: "config-file") pod "8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" (UID: "8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:03:27.651122 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.651100 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc" (OuterVolumeSpecName: "kube-api-access-95kjc") pod "8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" (UID: "8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17"). InnerVolumeSpecName "kube-api-access-95kjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:03:27.749924 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.749884 2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-config-file\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:03:27.749924 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:27.749923 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95kjc\" (UniqueName: \"kubernetes.io/projected/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17-kube-api-access-95kjc\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:03:28.387144 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.387105 2549 generic.go:356] "Generic (PLEG): container finished" podID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" containerID="5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3" exitCode=0 Jul 22 13:03:28.387658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.387190 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" Jul 22 13:03:28.387658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.387202 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" event={"ID":"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17","Type":"ContainerDied","Data":"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3"} Jul 22 13:03:28.387658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.387292 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5gqlp" event={"ID":"8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17","Type":"ContainerDied","Data":"c3d28cafeb372ae2ec3e22268f7384213c6678d444c51a4f96a1bb8a2c7e8771"} Jul 22 13:03:28.387658 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.387315 2549 scope.go:117] "RemoveContainer" containerID="5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3" Jul 22 13:03:28.397479 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.397462 2549 scope.go:117] "RemoveContainer" containerID="5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3" Jul 22 13:03:28.397779 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:03:28.397761 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3\": container with ID starting with 5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3 not found: ID does not exist" containerID="5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3" Jul 22 13:03:28.397832 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.397788 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3"} err="failed to get container status \"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3\": rpc error: code = NotFound desc = could not find container \"5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3\": container with ID starting with 5782665c862b67c0d3bf3319367bbb6d4d1bc7ee73989d901502104b61e347c3 not found: ID does not exist" Jul 22 13:03:28.402601 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.402574 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:28.423064 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.423041 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:28.428971 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.428953 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5gqlp"] Jul 22 13:03:28.501048 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.501020 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:28.555095 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.555065 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" path="/var/lib/kubelet/pods/8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17/volumes" Jul 22 13:03:28.907095 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.907065 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd"] Jul 22 13:03:28.907466 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.907448 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" containerName="limitador" Jul 22 13:03:28.907466 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.907466 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" containerName="limitador" Jul 22 13:03:28.907620 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.907586 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1e5b12-f507-4f4e-a5b0-1394d6f6ca17" containerName="limitador" Jul 22 13:03:28.910497 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.910476 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:28.915913 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.915890 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 13:03:28.915913 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.915899 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 22 13:03:28.917020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.917001 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bb765\"" Jul 22 13:03:28.917020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.917010 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 13:03:28.923771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.923751 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd"] Jul 22 13:03:28.958965 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.958933 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:28.960003 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.959985 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6xb\" (UniqueName: \"kubernetes.io/projected/56e15005-74b9-467e-ab5d-c52abaa8c878-kube-api-access-zt6xb\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:28.960090 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:28.960047 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/56e15005-74b9-467e-ab5d-c52abaa8c878-data\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.060452 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.060423 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6xb\" (UniqueName: \"kubernetes.io/projected/56e15005-74b9-467e-ab5d-c52abaa8c878-kube-api-access-zt6xb\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.060619 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.060481 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/56e15005-74b9-467e-ab5d-c52abaa8c878-data\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.060861 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.060832 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/56e15005-74b9-467e-ab5d-c52abaa8c878-data\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.070832 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.070803 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6xb\" (UniqueName: \"kubernetes.io/projected/56e15005-74b9-467e-ab5d-c52abaa8c878-kube-api-access-zt6xb\") pod \"postgres-69fb4594cf-lvqrd\" (UID: \"56e15005-74b9-467e-ab5d-c52abaa8c878\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.221483 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.221402 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:29.358700 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.358669 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd"] Jul 22 13:03:29.361663 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:03:29.361633 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e15005_74b9_467e_ab5d_c52abaa8c878.slice/crio-1cba844fc1b93a2e9cd6edb30bae4a1d5c35c9dec30bf1e6dc399f02a27d617a WatchSource:0}: Error finding container 1cba844fc1b93a2e9cd6edb30bae4a1d5c35c9dec30bf1e6dc399f02a27d617a: Status 404 returned error can't find the container with id 1cba844fc1b93a2e9cd6edb30bae4a1d5c35c9dec30bf1e6dc399f02a27d617a Jul 22 13:03:29.393137 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:29.393107 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" event={"ID":"56e15005-74b9-467e-ab5d-c52abaa8c878","Type":"ContainerStarted","Data":"1cba844fc1b93a2e9cd6edb30bae4a1d5c35c9dec30bf1e6dc399f02a27d617a"} Jul 22 13:03:33.701380 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:33.701338 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:34.424878 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:34.424834 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" event={"ID":"56e15005-74b9-467e-ab5d-c52abaa8c878","Type":"ContainerStarted","Data":"a5545a04b07fc2e1b4b317fb5c15f3414aeeedc9a41fb4fdbec3662dc33e07a1"} Jul 22 13:03:34.425053 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:34.424907 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:34.445805 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:34.445759 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" podStartSLOduration=1.572283506 podStartE2EDuration="6.445744405s" totalImagesPullingTime="4.873460899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:34.443990715 +0000 UTC m=+584.330627385" watchObservedRunningTime="2026-07-22 13:03:34.445744405 +0000 UTC m=+584.332381071" Jul 22 13:03:40.459776 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:40.459730 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lvqrd" Jul 22 13:03:40.963877 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:40.963843 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:41.040462 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:41.040427 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:47.511654 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.511614 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:47.514719 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.514695 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:03:47.519469 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.519453 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.524646 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.524627 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 13:03:47.525410 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.525386 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 13:03:47.525833 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.525815 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nmkw6\"" Jul 22 13:03:47.543855 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.543820 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:03:47.632171 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.632138 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzqdj\" (UniqueName: \"kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.632342 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.632188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.644556 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.644492 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:47.707532 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.707483 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:03:47.709897 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.709882 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.724385 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.724361 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:03:47.733139 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.733117 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.733240 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.733207 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzqdj\" (UniqueName: \"kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.735477 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.735454 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.751383 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.751355 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzqdj\" (UniqueName: \"kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj\") pod \"maas-controller-666cc4978f-cdvgn\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.752554 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.752528 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:47.832067 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.831978 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:47.834094 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.833746 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2sl\" (UniqueName: \"kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.834094 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.833792 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.935260 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.935219 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2sl\" (UniqueName: \"kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.935441 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.935309 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.937835 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.937809 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.946410 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.946388 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2sl\" (UniqueName: \"kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl\") pod \"maas-controller-5878d9c5b5-xctpp\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:47.968600 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:47.968571 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:03:47.970425 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:03:47.970398 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4213e2_0cdc_4200_bfc2_e5e98411a1b0.slice/crio-1709ff2c2b6acda347e8a6a276f52a30f9a002403de0b2a50cdae916196653b0 WatchSource:0}: Error finding container 1709ff2c2b6acda347e8a6a276f52a30f9a002403de0b2a50cdae916196653b0: Status 404 returned error can't find the container with id 1709ff2c2b6acda347e8a6a276f52a30f9a002403de0b2a50cdae916196653b0 Jul 22 13:03:48.020417 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:48.020392 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:48.155991 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:48.155965 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:03:48.157023 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:03:48.156997 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5857a8_960b_48e5_b5df_6e2c8be8171c.slice/crio-8cacd88140c8c8cede277c2197404a93dedc4008566dd9e3770b9381bd073f46 WatchSource:0}: Error finding container 8cacd88140c8c8cede277c2197404a93dedc4008566dd9e3770b9381bd073f46: Status 404 returned error can't find the container with id 8cacd88140c8c8cede277c2197404a93dedc4008566dd9e3770b9381bd073f46 Jul 22 13:03:48.501650 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:48.501554 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666cc4978f-cdvgn" event={"ID":"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0","Type":"ContainerStarted","Data":"1709ff2c2b6acda347e8a6a276f52a30f9a002403de0b2a50cdae916196653b0"} Jul 22 13:03:48.502709 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:48.502685 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" event={"ID":"fd5857a8-960b-48e5-b5df-6e2c8be8171c","Type":"ContainerStarted","Data":"8cacd88140c8c8cede277c2197404a93dedc4008566dd9e3770b9381bd073f46"} Jul 22 13:03:50.502172 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:50.502146 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:03:50.502612 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:50.502147 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:03:50.550028 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:50.550006 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 13:03:50.769600 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:50.769567 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:50.868952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:50.868920 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:03:51.521106 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.521070 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" event={"ID":"fd5857a8-960b-48e5-b5df-6e2c8be8171c","Type":"ContainerStarted","Data":"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f"} Jul 22 13:03:51.521598 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.521259 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:03:51.522660 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.522640 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666cc4978f-cdvgn" event={"ID":"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0","Type":"ContainerStarted","Data":"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e"} Jul 22 13:03:51.522786 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.522758 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:03:51.551046 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.551004 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" podStartSLOduration=2.162175828 podStartE2EDuration="4.550990343s" totalImagesPullingTime="2.388814515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:51.549739596 +0000 UTC m=+601.436376262" watchObservedRunningTime="2026-07-22 13:03:51.550990343 +0000 UTC m=+601.437627010" Jul 22 13:03:51.574894 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:03:51.574844 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-666cc4978f-cdvgn" podStartSLOduration=1.999858761 podStartE2EDuration="4.574829655s" totalImagesPullingTime="2.574970894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:51.57330721 +0000 UTC m=+601.459943877" watchObservedRunningTime="2026-07-22 13:03:51.574829655 +0000 UTC m=+601.461466322" Jul 22 13:04:02.533074 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:02.533044 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:04:02.535411 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:02.533200 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:04:02.643298 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:02.643265 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:04:02.643458 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:02.643431 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-666cc4978f-cdvgn" podUID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" containerName="manager" containerID="cri-o://4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e" gracePeriod=30 Jul 22 13:04:02.890025 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:02.890002 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:04:03.075342 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.075252 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzqdj\" (UniqueName: \"kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj\") pod \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " Jul 22 13:04:03.075342 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.075314 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert\") pod \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\" (UID: \"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0\") " Jul 22 13:04:03.077454 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.077419 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj" (OuterVolumeSpecName: "kube-api-access-tzqdj") pod "dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" (UID: "dc4213e2-0cdc-4200-bfc2-e5e98411a1b0"). InnerVolumeSpecName "kube-api-access-tzqdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:04:03.077591 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.077463 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" (UID: "dc4213e2-0cdc-4200-bfc2-e5e98411a1b0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:04:03.176602 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.176572 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzqdj\" (UniqueName: \"kubernetes.io/projected/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-kube-api-access-tzqdj\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:04:03.176602 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.176598 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0-webhook-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:04:03.588410 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.588377 2549 generic.go:356] "Generic (PLEG): container finished" podID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" containerID="4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e" exitCode=0 Jul 22 13:04:03.588898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.588422 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666cc4978f-cdvgn" Jul 22 13:04:03.588898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.588468 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666cc4978f-cdvgn" event={"ID":"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0","Type":"ContainerDied","Data":"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e"} Jul 22 13:04:03.588898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.588536 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666cc4978f-cdvgn" event={"ID":"dc4213e2-0cdc-4200-bfc2-e5e98411a1b0","Type":"ContainerDied","Data":"1709ff2c2b6acda347e8a6a276f52a30f9a002403de0b2a50cdae916196653b0"} Jul 22 13:04:03.588898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.588574 2549 scope.go:117] "RemoveContainer" containerID="4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e" Jul 22 13:04:03.598122 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.598101 2549 scope.go:117] "RemoveContainer" containerID="4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e" Jul 22 13:04:03.598362 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:04:03.598345 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e\": container with ID starting with 4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e not found: ID does not exist" containerID="4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e" Jul 22 13:04:03.598410 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.598370 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e"} err="failed to get container status \"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e\": rpc error: code = NotFound desc = could not find container \"4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e\": container with ID starting with 4dec68df6ce62f621216919a9d6613e37e7f36e0ba9e86e3076a194258ba7b2e not found: ID does not exist" Jul 22 13:04:03.614003 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.613982 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:04:03.621330 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:03.620211 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-666cc4978f-cdvgn"] Jul 22 13:04:04.526495 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:04.526461 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:04.554979 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:04.554952 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" path="/var/lib/kubelet/pods/dc4213e2-0cdc-4200-bfc2-e5e98411a1b0/volumes" Jul 22 13:04:22.586293 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:22.586187 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:22.745911 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:22.745866 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:23.224279 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.224244 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7878758c66-4ctfr"] Jul 22 13:04:23.224655 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.224634 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" containerName="manager" Jul 22 13:04:23.224655 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.224653 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" containerName="manager" Jul 22 13:04:23.224811 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.224736 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4213e2-0cdc-4200-bfc2-e5e98411a1b0" containerName="manager" Jul 22 13:04:23.227925 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.227910 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.230813 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.230793 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5td92\"" Jul 22 13:04:23.230901 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.230794 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 22 13:04:23.244811 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.244788 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac9c437-aafa-4315-84d5-71b1bb9742d4-openshift-service-ca\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.244934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.244824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4rdp\" (UniqueName: \"kubernetes.io/projected/3ac9c437-aafa-4315-84d5-71b1bb9742d4-kube-api-access-g4rdp\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.244934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.244886 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.254877 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.254854 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7878758c66-4ctfr"] Jul 22 13:04:23.345489 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.345455 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.345676 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.345540 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac9c437-aafa-4315-84d5-71b1bb9742d4-openshift-service-ca\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.345676 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.345582 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4rdp\" (UniqueName: \"kubernetes.io/projected/3ac9c437-aafa-4315-84d5-71b1bb9742d4-kube-api-access-g4rdp\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.345676 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:04:23.345624 2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 22 13:04:23.345823 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:04:23.345725 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls podName:3ac9c437-aafa-4315-84d5-71b1bb9742d4 nodeName:}" failed. No retries permitted until 2026-07-22 13:04:23.845704675 +0000 UTC m=+633.732341325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls") pod "maas-api-7878758c66-4ctfr" (UID: "3ac9c437-aafa-4315-84d5-71b1bb9742d4") : secret "maas-api-serving-cert" not found Jul 22 13:04:23.346208 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.346191 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ac9c437-aafa-4315-84d5-71b1bb9742d4-openshift-service-ca\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.362974 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.362943 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4rdp\" (UniqueName: \"kubernetes.io/projected/3ac9c437-aafa-4315-84d5-71b1bb9742d4-kube-api-access-g4rdp\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.849618 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.849583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.851935 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.851913 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ac9c437-aafa-4315-84d5-71b1bb9742d4-maas-api-tls\") pod \"maas-api-7878758c66-4ctfr\" (UID: \"3ac9c437-aafa-4315-84d5-71b1bb9742d4\") " pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:23.915597 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:23.915563 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:24.053551 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.053501 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:24.137549 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.137460 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:24.244384 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.244310 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:24.317209 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.317171 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7878758c66-4ctfr"] Jul 22 13:04:24.319432 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:04:24.319399 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac9c437_aafa_4315_84d5_71b1bb9742d4.slice/crio-c1828512c6edb5f63b759463468d0b2453fd35bd6e635338c4778ec0bf402d0b WatchSource:0}: Error finding container c1828512c6edb5f63b759463468d0b2453fd35bd6e635338c4778ec0bf402d0b: Status 404 returned error can't find the container with id c1828512c6edb5f63b759463468d0b2453fd35bd6e635338c4778ec0bf402d0b Jul 22 13:04:24.320710 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.320695 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:04:24.362976 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.362951 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:24.461164 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.461084 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97sft"] Jul 22 13:04:24.465771 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.465752 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.473058 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.473030 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 13:04:24.483656 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.483630 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97sft"] Jul 22 13:04:24.528789 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.528757 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tl5zh"] Jul 22 13:04:24.531063 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.531048 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.534373 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.534355 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n6n5q\"" Jul 22 13:04:24.548047 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.548022 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tl5zh"] Jul 22 13:04:24.556711 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.556689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8285281-9c99-40ad-9c4f-1d7d78a8e680-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.556814 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.556744 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64s2b\" (UniqueName: \"kubernetes.io/projected/d8285281-9c99-40ad-9c4f-1d7d78a8e680-kube-api-access-64s2b\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.556880 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.556811 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87st\" (UniqueName: \"kubernetes.io/projected/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-kube-api-access-l87st\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.556880 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.556863 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.657825 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.657790 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8285281-9c99-40ad-9c4f-1d7d78a8e680-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.658020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.657856 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64s2b\" (UniqueName: \"kubernetes.io/projected/d8285281-9c99-40ad-9c4f-1d7d78a8e680-kube-api-access-64s2b\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.658020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.657877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l87st\" (UniqueName: \"kubernetes.io/projected/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-kube-api-access-l87st\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.658020 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.657896 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.658556 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.658536 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.658899 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.658878 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8285281-9c99-40ad-9c4f-1d7d78a8e680-plugins-config-volume\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.679444 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.679413 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64s2b\" (UniqueName: \"kubernetes.io/projected/d8285281-9c99-40ad-9c4f-1d7d78a8e680-kube-api-access-64s2b\") pod \"payload-processing-5bf47cd988-tl5zh\" (UID: \"d8285281-9c99-40ad-9c4f-1d7d78a8e680\") " pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.679613 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.679595 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87st\" (UniqueName: \"kubernetes.io/projected/fd3a9fb6-d6e4-4843-9a1e-c01b14664f13-kube-api-access-l87st\") pod \"payload-pre-processing-7677b774bb-97sft\" (UID: \"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.703453 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.703423 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" event={"ID":"3ac9c437-aafa-4315-84d5-71b1bb9742d4","Type":"ContainerStarted","Data":"c1828512c6edb5f63b759463468d0b2453fd35bd6e635338c4778ec0bf402d0b"} Jul 22 13:04:24.775853 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.775820 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:24.840750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.840725 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:24.942370 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.942310 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97sft"] Jul 22 13:04:24.943105 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:04:24.943080 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3a9fb6_d6e4_4843_9a1e_c01b14664f13.slice/crio-115ba7f4a6d352f330987277dbb1726abc5d32be89143852375c4167c50893ab WatchSource:0}: Error finding container 115ba7f4a6d352f330987277dbb1726abc5d32be89143852375c4167c50893ab: Status 404 returned error can't find the container with id 115ba7f4a6d352f330987277dbb1726abc5d32be89143852375c4167c50893ab Jul 22 13:04:24.993488 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:24.993460 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-tl5zh"] Jul 22 13:04:24.996229 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:04:24.996200 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8285281_9c99_40ad_9c4f_1d7d78a8e680.slice/crio-89437df76409c71e77299dff15153ee3dbb1f141be66271be49f9eb95d2f563e WatchSource:0}: Error finding container 89437df76409c71e77299dff15153ee3dbb1f141be66271be49f9eb95d2f563e: Status 404 returned error can't find the container with id 89437df76409c71e77299dff15153ee3dbb1f141be66271be49f9eb95d2f563e Jul 22 13:04:25.711334 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:25.711285 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" event={"ID":"d8285281-9c99-40ad-9c4f-1d7d78a8e680","Type":"ContainerStarted","Data":"89437df76409c71e77299dff15153ee3dbb1f141be66271be49f9eb95d2f563e"} Jul 22 13:04:25.712781 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:25.712734 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" event={"ID":"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13","Type":"ContainerStarted","Data":"115ba7f4a6d352f330987277dbb1726abc5d32be89143852375c4167c50893ab"} Jul 22 13:04:26.730950 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:26.730326 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" event={"ID":"3ac9c437-aafa-4315-84d5-71b1bb9742d4","Type":"ContainerStarted","Data":"e35e6cdfa86c83a19f89d7aa899b6bdac5a40b288492b47f162f915c93152d8d"} Jul 22 13:04:26.730950 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:26.730942 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:26.784788 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:26.784735 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" podStartSLOduration=2.145938888 podStartE2EDuration="3.784714772s" totalImagesPullingTime="1.638775884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:04:26.784544574 +0000 UTC m=+636.671181251" watchObservedRunningTime="2026-07-22 13:04:26.784714772 +0000 UTC m=+636.671351439" Jul 22 13:04:27.739435 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.739393 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" event={"ID":"d8285281-9c99-40ad-9c4f-1d7d78a8e680","Type":"ContainerStarted","Data":"662fe0d4c8b9e99aa01ef667112b94914bf44841248fad28eb4aa8cec7106f30"} Jul 22 13:04:27.739917 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.739463 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:27.741139 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.741116 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" event={"ID":"fd3a9fb6-d6e4-4843-9a1e-c01b14664f13","Type":"ContainerStarted","Data":"1f5f8148537f51c418a2715365ed87ebf2cc603a526f6a956630a4c0d3eddfed"} Jul 22 13:04:27.741333 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.741319 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:27.782236 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.782169 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" podStartSLOduration=1.5688049419999999 podStartE2EDuration="3.782149396s" totalImagesPullingTime="2.213344454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:04:27.780913594 +0000 UTC m=+637.667550260" watchObservedRunningTime="2026-07-22 13:04:27.782149396 +0000 UTC m=+637.668786062" Jul 22 13:04:27.816462 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:27.816396 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" podStartSLOduration=1.5456815480000001 podStartE2EDuration="3.816381567s" totalImagesPullingTime="2.270700019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:04:27.815228339 +0000 UTC m=+637.701865006" watchObservedRunningTime="2026-07-22 13:04:27.816381567 +0000 UTC m=+637.703018232" Jul 22 13:04:33.753651 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:33.753619 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7878758c66-4ctfr" Jul 22 13:04:34.839001 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:34.838960 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:35.034817 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:35.034782 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:38.749082 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:38.749026 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" podUID="fd3a9fb6-d6e4-4843-9a1e-c01b14664f13" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.52:9004: connect: connection refused" Jul 22 13:04:38.749553 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:38.749534 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-tl5zh" Jul 22 13:04:47.415346 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.415312 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx"] Jul 22 13:04:47.419867 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.419843 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.434385 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.434359 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 13:04:47.435928 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.435901 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 13:04:47.435928 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.435921 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vvhw8\"" Jul 22 13:04:47.436069 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.435985 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 22 13:04:47.453564 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.453540 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx"] Jul 22 13:04:47.494709 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.494675 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:47.566667 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.566667 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566668 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.566841 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566745 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.566841 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566792 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5270531-2a1d-4417-a542-9e8f3415fc9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.566841 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566820 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx2g6\" (UniqueName: \"kubernetes.io/projected/b5270531-2a1d-4417-a542-9e8f3415fc9b-kube-api-access-qx2g6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.566952 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.566843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.667962 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.667886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.667962 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.667927 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5270531-2a1d-4417-a542-9e8f3415fc9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.667962 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.667952 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx2g6\" (UniqueName: \"kubernetes.io/projected/b5270531-2a1d-4417-a542-9e8f3415fc9b-kube-api-access-qx2g6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668251 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668079 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668316 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668255 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668316 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668284 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668458 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668436 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668659 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668634 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.668750 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.668706 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.670482 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.670465 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5270531-2a1d-4417-a542-9e8f3415fc9b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.670575 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.670487 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5270531-2a1d-4417-a542-9e8f3415fc9b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.688823 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.688799 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx2g6\" (UniqueName: \"kubernetes.io/projected/b5270531-2a1d-4417-a542-9e8f3415fc9b-kube-api-access-qx2g6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx\" (UID: \"b5270531-2a1d-4417-a542-9e8f3415fc9b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.729813 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.729785 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:47.882255 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:47.882229 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx"] Jul 22 13:04:47.884118 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:04:47.884087 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5270531_2a1d_4417_a542_9e8f3415fc9b.slice/crio-4812b04b172bec188d9b791eb82400194f859ec059d3ec80009319309cef08d7 WatchSource:0}: Error finding container 4812b04b172bec188d9b791eb82400194f859ec059d3ec80009319309cef08d7: Status 404 returned error can't find the container with id 4812b04b172bec188d9b791eb82400194f859ec059d3ec80009319309cef08d7 Jul 22 13:04:48.748683 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:48.748652 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97sft" Jul 22 13:04:48.858108 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:48.858078 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" event={"ID":"b5270531-2a1d-4417-a542-9e8f3415fc9b","Type":"ContainerStarted","Data":"4812b04b172bec188d9b791eb82400194f859ec059d3ec80009319309cef08d7"} Jul 22 13:04:49.865251 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:49.865212 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" event={"ID":"b5270531-2a1d-4417-a542-9e8f3415fc9b","Type":"ContainerStarted","Data":"bb9540831ef1b66b3c2f794e2912ddbec27073c9e639fd750d5eccaabe851dcf"} Jul 22 13:04:49.896678 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:49.896631 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" podStartSLOduration=1.574510568 podStartE2EDuration="2.896615313s" totalImagesPullingTime="1.322104745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:04:49.89476356 +0000 UTC m=+659.781400225" watchObservedRunningTime="2026-07-22 13:04:49.896615313 +0000 UTC m=+659.783252019" Jul 22 13:04:56.449995 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:56.449956 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:04:57.730395 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:57.730362 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:57.730848 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:57.730428 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:57.743227 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:57.743203 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:04:57.923711 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:04:57.923681 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx" Jul 22 13:05:10.056812 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:05:10.056775 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:05:21.984916 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:05:21.984865 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:05:28.157460 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:05:28.157424 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:05:42.685059 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:05:42.685018 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:05:53.586312 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:05:53.586268 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:06:00.575136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:06:00.575101 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:07:52.516789 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:07:52.516756 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:07:56.390608 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:07:56.390578 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:07:56.506495 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:07:56.506465 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:07:57.490759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:07:57.490726 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:07:57.586097 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:07:57.586063 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:08:43.625240 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:43.625164 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:08:43.625682 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:43.625427 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" podUID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" containerName="manager" containerID="cri-o://f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f" gracePeriod=30 Jul 22 13:08:43.880908 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:43.880831 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:08:44.017591 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.017562 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt2sl\" (UniqueName: \"kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl\") pod \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " Jul 22 13:08:44.017752 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.017604 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert\") pod \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\" (UID: \"fd5857a8-960b-48e5-b5df-6e2c8be8171c\") " Jul 22 13:08:44.019797 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.019758 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl" (OuterVolumeSpecName: "kube-api-access-kt2sl") pod "fd5857a8-960b-48e5-b5df-6e2c8be8171c" (UID: "fd5857a8-960b-48e5-b5df-6e2c8be8171c"). InnerVolumeSpecName "kube-api-access-kt2sl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:08:44.019939 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.019855 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fd5857a8-960b-48e5-b5df-6e2c8be8171c" (UID: "fd5857a8-960b-48e5-b5df-6e2c8be8171c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:08:44.119334 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.119304 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt2sl\" (UniqueName: \"kubernetes.io/projected/fd5857a8-960b-48e5-b5df-6e2c8be8171c-kube-api-access-kt2sl\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:08:44.119334 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.119331 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd5857a8-960b-48e5-b5df-6e2c8be8171c-webhook-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:08:44.136638 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.136562 2549 generic.go:356] "Generic (PLEG): container finished" podID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" containerID="f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f" exitCode=0 Jul 22 13:08:44.136638 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.136601 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" Jul 22 13:08:44.136777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.136651 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" event={"ID":"fd5857a8-960b-48e5-b5df-6e2c8be8171c","Type":"ContainerDied","Data":"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f"} Jul 22 13:08:44.136777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.136697 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-xctpp" event={"ID":"fd5857a8-960b-48e5-b5df-6e2c8be8171c","Type":"ContainerDied","Data":"8cacd88140c8c8cede277c2197404a93dedc4008566dd9e3770b9381bd073f46"} Jul 22 13:08:44.136777 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.136718 2549 scope.go:117] "RemoveContainer" containerID="f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f" Jul 22 13:08:44.147704 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.147688 2549 scope.go:117] "RemoveContainer" containerID="f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f" Jul 22 13:08:44.147929 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:08:44.147911 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f\": container with ID starting with f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f not found: ID does not exist" containerID="f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f" Jul 22 13:08:44.147978 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.147938 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f"} err="failed to get container status \"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f\": rpc error: code = NotFound desc = could not find container \"f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f\": container with ID starting with f296bc96fdf7027a97e9eda6c5902493fd8a20ed841e2c72ed75276ff28efd2f not found: ID does not exist" Jul 22 13:08:44.181252 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.181232 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:08:44.187943 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.187923 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-xctpp"] Jul 22 13:08:44.555586 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:44.555555 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" path="/var/lib/kubelet/pods/fd5857a8-960b-48e5-b5df-6e2c8be8171c/volumes" Jul 22 13:08:50.541634 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:50.541600 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:08:50.542737 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:08:50.542714 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:09:44.986443 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.986410 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:09:44.986909 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.986823 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" containerName="manager" Jul 22 13:09:44.986909 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.986835 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" containerName="manager" Jul 22 13:09:44.986909 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.986907 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5857a8-960b-48e5-b5df-6e2c8be8171c" containerName="manager" Jul 22 13:09:44.989973 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.989958 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:44.993857 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.993835 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nmkw6\"" Jul 22 13:09:44.993980 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.993836 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 13:09:44.993980 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:44.993883 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 13:09:45.000626 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.000597 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:09:45.061728 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.061696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tg72\" (UniqueName: \"kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.061922 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.061854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.163077 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.163042 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.163286 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.163108 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tg72\" (UniqueName: \"kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.165542 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.165507 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.174091 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.174070 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tg72\" (UniqueName: \"kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72\") pod \"maas-controller-5878d9c5b5-5qkql\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.302158 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.302123 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:45.439835 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.439806 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:09:45.440565 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:09:45.440536 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b4e3a0_59b0_4021_9336_0fae4a23ba9a.slice/crio-b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61 WatchSource:0}: Error finding container b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61: Status 404 returned error can't find the container with id b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61 Jul 22 13:09:45.442110 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.442094 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:09:45.484236 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:45.484207 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" event={"ID":"28b4e3a0-59b0-4021-9336-0fae4a23ba9a","Type":"ContainerStarted","Data":"b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61"} Jul 22 13:09:47.496225 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:47.496192 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" event={"ID":"28b4e3a0-59b0-4021-9336-0fae4a23ba9a","Type":"ContainerStarted","Data":"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e"} Jul 22 13:09:47.496674 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:47.496254 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:09:47.517064 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:47.517013 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" podStartSLOduration=2.237404728 podStartE2EDuration="3.516997583s" totalImagesPullingTime="1.279592855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:09:47.515304038 +0000 UTC m=+957.401940706" watchObservedRunningTime="2026-07-22 13:09:47.516997583 +0000 UTC m=+957.403634250" Jul 22 13:09:58.506179 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:09:58.506150 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:10:03.064039 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.064006 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:03.147588 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.147556 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:10:03.147805 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.147779 2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" podUID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" containerName="manager" containerID="cri-o://22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e" gracePeriod=30 Jul 22 13:10:03.402900 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.402878 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:10:03.531380 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.531340 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert\") pod \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " Jul 22 13:10:03.531698 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.531459 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tg72\" (UniqueName: \"kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72\") pod \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\" (UID: \"28b4e3a0-59b0-4021-9336-0fae4a23ba9a\") " Jul 22 13:10:03.533459 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.533431 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "28b4e3a0-59b0-4021-9336-0fae4a23ba9a" (UID: "28b4e3a0-59b0-4021-9336-0fae4a23ba9a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 13:10:03.533572 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.533541 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72" (OuterVolumeSpecName: "kube-api-access-8tg72") pod "28b4e3a0-59b0-4021-9336-0fae4a23ba9a" (UID: "28b4e3a0-59b0-4021-9336-0fae4a23ba9a"). InnerVolumeSpecName "kube-api-access-8tg72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:10:03.582784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.582707 2549 generic.go:356] "Generic (PLEG): container finished" podID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" containerID="22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e" exitCode=0 Jul 22 13:10:03.582784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.582752 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" Jul 22 13:10:03.582784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.582766 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" event={"ID":"28b4e3a0-59b0-4021-9336-0fae4a23ba9a","Type":"ContainerDied","Data":"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e"} Jul 22 13:10:03.582999 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.582801 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-5qkql" event={"ID":"28b4e3a0-59b0-4021-9336-0fae4a23ba9a","Type":"ContainerDied","Data":"b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61"} Jul 22 13:10:03.582999 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.582817 2549 scope.go:117] "RemoveContainer" containerID="22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e" Jul 22 13:10:03.592155 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.592138 2549 scope.go:117] "RemoveContainer" containerID="22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e" Jul 22 13:10:03.592389 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:10:03.592363 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e\": container with ID starting with 22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e not found: ID does not exist" containerID="22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e" Jul 22 13:10:03.592481 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.592394 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e"} err="failed to get container status \"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e\": rpc error: code = NotFound desc = could not find container \"22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e\": container with ID starting with 22d6296c41e5828fa27e8a01f19706186f7bb4cd7466a7b219de1387985cdc4e not found: ID does not exist" Jul 22 13:10:03.615159 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:10:03.615134 2549 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b4e3a0_59b0_4021_9336_0fae4a23ba9a.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b4e3a0_59b0_4021_9336_0fae4a23ba9a.slice/crio-b1e8e0a677349bbaad2830e42592dd5a18701bcb792daed4637de6f16b7c7c61\": RecentStats: unable to find data in memory cache]" Jul 22 13:10:03.615540 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.615511 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:10:03.620378 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.620354 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-5qkql"] Jul 22 13:10:03.633343 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.633324 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-webhook-cert\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:10:03.633343 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:03.633342 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tg72\" (UniqueName: \"kubernetes.io/projected/28b4e3a0-59b0-4021-9336-0fae4a23ba9a-kube-api-access-8tg72\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:10:04.411375 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.411343 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-t4b74"] Jul 22 13:10:04.411851 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.411755 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" containerName="manager" Jul 22 13:10:04.411851 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.411768 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" containerName="manager" Jul 22 13:10:04.411933 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.411854 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" containerName="manager" Jul 22 13:10:04.416217 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.416197 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.420045 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.420026 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nmkw6\"" Jul 22 13:10:04.420210 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.420091 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 13:10:04.420210 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.420140 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 13:10:04.424757 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.424489 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-t4b74"] Jul 22 13:10:04.541610 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.541575 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4h7\" (UniqueName: \"kubernetes.io/projected/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-kube-api-access-5j4h7\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.541790 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.541691 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-webhook-cert\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.555007 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.554983 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b4e3a0-59b0-4021-9336-0fae4a23ba9a" path="/var/lib/kubelet/pods/28b4e3a0-59b0-4021-9336-0fae4a23ba9a/volumes" Jul 22 13:10:04.642624 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.642593 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-webhook-cert\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.642784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.642647 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4h7\" (UniqueName: \"kubernetes.io/projected/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-kube-api-access-5j4h7\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.645036 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.645008 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-webhook-cert\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.651850 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.651826 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4h7\" (UniqueName: \"kubernetes.io/projected/20c58a5a-d7a2-4a4a-b6ff-4380f97cd926-kube-api-access-5j4h7\") pod \"maas-controller-5878d9c5b5-t4b74\" (UID: \"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926\") " pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.728235 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.728163 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:04.863920 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:04.863898 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5878d9c5b5-t4b74"] Jul 22 13:10:04.865694 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:10:04.865666 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c58a5a_d7a2_4a4a_b6ff_4380f97cd926.slice/crio-33958399002e30de31b3a056e446fd8daf037d7d73df0e19fee9e57b2c5bb967 WatchSource:0}: Error finding container 33958399002e30de31b3a056e446fd8daf037d7d73df0e19fee9e57b2c5bb967: Status 404 returned error can't find the container with id 33958399002e30de31b3a056e446fd8daf037d7d73df0e19fee9e57b2c5bb967 Jul 22 13:10:05.597133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:05.597036 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" event={"ID":"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926","Type":"ContainerStarted","Data":"4cf330843b40cdc2bb3e0780e2bd1959330b37361fac89bcfc1686745cd41a2b"} Jul 22 13:10:05.597133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:05.597093 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" event={"ID":"20c58a5a-d7a2-4a4a-b6ff-4380f97cd926","Type":"ContainerStarted","Data":"33958399002e30de31b3a056e446fd8daf037d7d73df0e19fee9e57b2c5bb967"} Jul 22 13:10:05.597133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:05.597128 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:05.617173 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:05.617125 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" podStartSLOduration=1.2215097 podStartE2EDuration="1.617108804s" totalImagesPullingTime="395.599104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:10:05.615234566 +0000 UTC m=+975.501871235" watchObservedRunningTime="2026-07-22 13:10:05.617108804 +0000 UTC m=+975.503745470" Jul 22 13:10:05.996299 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:05.996212 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:16.604571 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:16.604493 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5878d9c5b5-t4b74" Jul 22 13:10:18.743642 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:18.743603 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:39.906374 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:39.906339 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:40.008252 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:40.008216 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:40.140282 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:40.140250 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:49.066194 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:49.066158 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:51.775584 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:51.775543 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:53.177426 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:53.177391 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:10:53.249022 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:10:53.248989 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:11:39.051874 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:11:39.051831 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:11:39.112906 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:11:39.112874 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:13:39.776655 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:13:39.776576 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:13:50.579275 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:13:50.579247 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:13:50.590632 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:13:50.590608 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:14:32.434759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:14:32.434689 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:14:32.535117 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:14:32.535087 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:15:51.040609 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:51.040571 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:15:55.318767 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.318731 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt"] Jul 22 13:15:55.322154 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.322136 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.325140 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.325117 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2lfdr\"" Jul 22 13:15:55.334118 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.334094 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt"] Jul 22 13:15:55.418507 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.418471 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.418724 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.418635 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwkdm\" (UniqueName: \"kubernetes.io/projected/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-kube-api-access-bwkdm\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.519795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.519761 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwkdm\" (UniqueName: \"kubernetes.io/projected/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-kube-api-access-bwkdm\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.519795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.519799 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.520141 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.520124 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.533491 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.533467 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwkdm\" (UniqueName: \"kubernetes.io/projected/0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba-kube-api-access-bwkdm\") pod \"kuadrant-operator-controller-manager-86878c769f-2kwmt\" (UID: \"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.632259 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.632167 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:55.778136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:55.778111 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt"] Jul 22 13:15:55.780290 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:15:55.780266 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0720312b_27ae_4eb1_ae4d_d8c4ca97d3ba.slice/crio-b3897d9e6fb5d7ce03d0ec778bf37d3ec5a999ce62f68ca37349eda34cd31a72 WatchSource:0}: Error finding container b3897d9e6fb5d7ce03d0ec778bf37d3ec5a999ce62f68ca37349eda34cd31a72: Status 404 returned error can't find the container with id b3897d9e6fb5d7ce03d0ec778bf37d3ec5a999ce62f68ca37349eda34cd31a72 Jul 22 13:15:56.498016 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:56.497982 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" event={"ID":"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba","Type":"ContainerStarted","Data":"9d56123b6001529c7ece0612e1dad5a46efe2875cae08fedfe8a5bca21cb47bf"} Jul 22 13:15:56.498465 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:56.498030 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" event={"ID":"0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba","Type":"ContainerStarted","Data":"b3897d9e6fb5d7ce03d0ec778bf37d3ec5a999ce62f68ca37349eda34cd31a72"} Jul 22 13:15:56.498465 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:56.498058 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:15:56.528323 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:15:56.528256 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" podStartSLOduration=1.528231854 podStartE2EDuration="1.528231854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:15:56.52072973 +0000 UTC m=+1326.407366398" watchObservedRunningTime="2026-07-22 13:15:56.528231854 +0000 UTC m=+1326.414868525" Jul 22 13:16:07.507224 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:16:07.507194 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2kwmt" Jul 22 13:18:40.806812 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:18:40.806772 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:18:50.617283 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:18:50.617256 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:18:50.629693 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:18:50.629668 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:18:54.149866 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:18:54.149831 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:19:10.649187 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:19:10.649149 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:19:12.626760 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:19:12.626722 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:20:07.587397 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:20:07.587357 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:20:07.646449 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:20:07.646413 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:16.697301 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:16.697222 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:38.062603 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:38.062571 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:41.047949 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:41.047894 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:41.134891 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:41.134858 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:41.499967 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:41.499877 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:47.518235 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:47.518197 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:47.663202 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:47.663172 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:47.787618 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:47.787482 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:48.078208 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:48.078116 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:48.147930 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:48.147892 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:50.584442 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:50.584401 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:50.685617 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:50.685578 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:50.776224 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:50.776189 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:51.124086 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:51.124057 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:51.257238 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:51.257193 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:22:51.357802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:22:51.357770 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:26.601886 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:26.601813 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:31.230051 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:31.230014 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:32.219838 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:32.219807 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:32.326300 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:32.326272 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:32.536270 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:32.536241 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:32.744428 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:32.744396 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:37.636364 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:37.636317 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:37.783161 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:37.783128 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:38.140029 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:38.139995 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:38.342237 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:38.342197 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:38.436181 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:38.436083 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:23:50.654784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:50.654759 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:23:50.668459 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:23:50.668437 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:24:08.155428 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:08.155398 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:13.097712 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:13.097678 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:17.704094 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:17.704052 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:17.863932 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:17.863900 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:18.089629 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:18.089595 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:18.319059 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:18.318997 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:18.641406 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:18.641374 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:18.765889 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:18.765857 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:21.021057 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:21.021026 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:21.117166 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:21.117133 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:21.286262 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:21.286152 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:21.482194 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:21.482163 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:21.938842 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:21.938810 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:22.040395 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:22.040358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:24:57.283583 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:24:57.283539 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:01.901696 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:01.901658 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:03.147788 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:03.147731 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:05.431262 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:05.431207 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:05.501056 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:05.501017 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:07.921281 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:07.921232 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:07.992716 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:07.992685 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:26.794437 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:26.794365 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:26.894253 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:26.894222 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:28.635485 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:28.635446 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:28.740553 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:28.740506 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:41.285720 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:41.285677 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:45.906838 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:45.906797 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:46.079756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:46.079726 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:46.361479 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:46.361446 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:46.786556 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:46.786497 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:46.889364 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:46.889329 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:46.988433 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:46.988400 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:48.409689 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:48.409658 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:55.382728 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:55.382692 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:55.542428 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:55.542393 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:55.642492 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:55.642407 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:25:56.111809 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:25:56.111772 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:07.840486 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:07.840438 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:07.911201 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:07.911161 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:22.092587 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:22.092551 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:29.087141 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:29.087099 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:29.194466 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:29.194431 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:29.317281 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:29.317246 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:46.009252 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:46.009165 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:51.432356 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:51.432302 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:52.403174 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:52.403140 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:26:52.503335 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:26:52.503299 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:02.152353 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:02.152314 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:02.947984 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:02.947952 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:10.126821 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:10.126785 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:10.231043 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:10.231005 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:10.326730 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:10.326697 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:10.426592 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:10.426469 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:11.235890 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:11.235854 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:11.331365 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:11.331331 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:11.565196 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:11.565162 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:13.072560 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:13.072529 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:18.425170 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:18.425125 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:20.506694 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:20.506659 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:26.087270 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:26.087222 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:26.188531 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:26.188475 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:26.331240 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:26.331202 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:26.673473 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:26.673439 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:26.877764 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:26.877714 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:29.390412 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:29.390372 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:29.484109 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:29.484075 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:29.691622 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:29.691528 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:29.859802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:29.859764 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:30.258795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:30.258761 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:30.361203 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:30.361155 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:33.904879 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:33.904839 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:34.621497 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:34.621464 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:34.719932 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:34.719902 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:35.043028 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:35.042990 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:42.853588 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:42.853554 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:42.954601 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:42.954569 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:52.014942 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:52.014901 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:56.528923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:56.528893 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:27:56.957413 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:27:56.957327 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:03.129395 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:03.129363 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:03.195102 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:03.195070 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:03.431574 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:03.431465 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:03.673393 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:03.673360 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:06.065962 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:06.065932 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:06.164336 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:06.164304 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:10.128205 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:10.128172 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:10.226768 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:10.226735 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:10.326052 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:10.326023 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:10.497668 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:10.497581 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:17.045898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:17.045807 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:17.128152 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:17.128127 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:23.946671 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:23.946635 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:24.268302 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:24.268267 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:24.434963 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:24.434923 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:27.620259 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:27.620229 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:27.724430 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:27.724397 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:27.815037 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:27.815005 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:28.047604 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:28.047568 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:28.482770 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:28.482682 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:28.583802 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:28.583758 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:32.116397 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:32.116358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:40.784902 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:40.784862 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:28:50.693991 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:50.693964 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:28:50.708612 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:28:50.708591 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:29:21.113005 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:29:21.112971 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:29:25.728157 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:29:25.728123 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:29:27.984429 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:29:27.984383 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:29:33.060590 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:29:33.060556 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:09.956414 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:09.956383 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:10.762471 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:10.762441 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:15.578752 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:15.578720 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:19.027254 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:19.027216 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:19.127477 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:19.127422 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:19.699585 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:19.699539 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:26.567284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:26.567242 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:26.642488 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:26.642452 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:27.269781 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:27.269725 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:27.774587 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:27.774550 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:27.871807 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:27.871762 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:35.443873 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:35.443835 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:35.536939 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:35.536900 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:38.259326 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:38.259285 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:46.034162 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:46.034127 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:30:46.407738 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:30:46.407653 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:07.399151 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:07.399113 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:14.576841 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:14.576756 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:14.685285 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:14.685245 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:14.937385 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:14.937303 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:15.266619 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:15.266577 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:15.496613 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:15.496578 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:18.564677 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:18.564643 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:18.677363 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:18.677332 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:18.819253 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:18.819158 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:18.998234 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:18.998201 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:19.503378 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:19.503344 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:19.640235 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:19.640203 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:23.092334 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:23.092298 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:23.397581 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:23.397483 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:23.819117 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:23.819082 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:24.125274 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:24.125180 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:26.532904 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:26.532872 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:26.623602 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:26.623561 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:26.788581 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:26.788473 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:26.921054 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:26.921024 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:27.300160 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:27.300126 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:27.400964 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:27.400922 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:31.033373 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:31.033338 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:38.426703 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:38.426671 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:42.038053 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:42.038008 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:42.136382 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:42.136349 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:49.232346 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:49.232311 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:49.332878 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:49.332839 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:31:49.652792 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:31:49.652755 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:10.258197 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:10.258159 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:27.790775 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:27.790739 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:29.390485 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:29.390451 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:48.911860 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:48.911774 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:49.012735 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:49.012693 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:56.301449 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:56.301401 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:56.370554 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:56.370478 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:57.219739 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.219708 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:57.347646 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.347614 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2"] Jul 22 13:32:57.351193 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.351173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:32:57.353686 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.353664 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bpvdk\"" Jul 22 13:32:57.358529 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.358494 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2"] Jul 22 13:32:57.519310 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.519280 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2\" (UID: \"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:32:57.619940 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.619905 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2\" (UID: \"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:32:57.620493 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.620476 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2\" (UID: \"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:32:57.664537 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.664488 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:32:57.807309 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.807279 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2"] Jul 22 13:32:57.808683 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:32:57.808659 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9cb5a1_be7a_44bc_8f5f_cab9e568cc85.slice/crio-5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53 WatchSource:0}: Error finding container 5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53: Status 404 returned error can't find the container with id 5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53 Jul 22 13:32:57.810665 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:57.810649 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:32:58.043155 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:58.043122 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:58.141568 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:58.141451 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:32:58.205245 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:32:58.205206 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" event={"ID":"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85","Type":"ContainerStarted","Data":"5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53"} Jul 22 13:33:01.224318 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:01.224281 2549 generic.go:356] "Generic (PLEG): container finished" podID="6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" containerID="53e6207d85b964ab7b6effdd05081b39f53f2ffbc99daec14a9ff40fb5e76008" exitCode=0 Jul 22 13:33:01.224708 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:01.224363 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" event={"ID":"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85","Type":"ContainerDied","Data":"53e6207d85b964ab7b6effdd05081b39f53f2ffbc99daec14a9ff40fb5e76008"} Jul 22 13:33:02.368875 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:02.368830 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:33:02.461837 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:02.461801 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca\") pod \"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85\" (UID: \"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85\") " Jul 22 13:33:02.462170 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:02.462149 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" (UID: "6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:33:02.562579 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:02.562551 2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85-maas-api-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:33:03.237323 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:03.237293 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" event={"ID":"6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85","Type":"ContainerDied","Data":"5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53"} Jul 22 13:33:03.237501 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:03.237347 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5abdede61a5addcebb51f24579564af2e5eb782e19be3a617297a445bee96c53" Jul 22 13:33:03.237501 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:03.237305 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2" Jul 22 13:33:07.828272 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:07.828236 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:12.426462 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:12.426424 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:12.442822 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:12.442774 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2"] Jul 22 13:33:12.446009 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:12.445983 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc03a6-fsrk2"] Jul 22 13:33:12.555096 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:12.555058 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" path="/var/lib/kubelet/pods/6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85/volumes" Jul 22 13:33:12.838675 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:12.838634 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:19.297286 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.297253 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:19.400853 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.400819 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:19.578599 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.578489 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:19.808098 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.808063 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:19.926711 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.926626 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf"] Jul 22 13:33:19.927134 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.927116 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" containerName="revoke-keys" Jul 22 13:33:19.927220 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.927137 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" containerName="revoke-keys" Jul 22 13:33:19.927282 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.927273 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9cb5a1-be7a-44bc-8f5f-cab9e568cc85" containerName="revoke-keys" Jul 22 13:33:19.931716 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.931696 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:19.934536 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.934495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bpvdk\"" Jul 22 13:33:19.937489 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:19.937465 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf"] Jul 22 13:33:20.012401 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.012372 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf\" (UID: \"c52ade64-cf34-4c38-b28a-f02c4a277652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:20.113060 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.113020 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf\" (UID: \"c52ade64-cf34-4c38-b28a-f02c4a277652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:20.113650 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.113630 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf\" (UID: \"c52ade64-cf34-4c38-b28a-f02c4a277652\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:20.245084 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.245000 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:20.392857 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.392749 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf"] Jul 22 13:33:20.397472 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:33:20.397436 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52ade64_cf34_4c38_b28a_f02c4a277652.slice/crio-03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464 WatchSource:0}: Error finding container 03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464: Status 404 returned error can't find the container with id 03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464 Jul 22 13:33:20.495729 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.495649 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:20.595890 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:20.595858 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:21.338146 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:21.338116 2549 generic.go:356] "Generic (PLEG): container finished" podID="c52ade64-cf34-4c38-b28a-f02c4a277652" containerID="db1e03bee9b6ee8de46928d3ec930886261f27678f9daa3ab87baad8810b4790" exitCode=0 Jul 22 13:33:21.338331 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:21.338204 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" event={"ID":"c52ade64-cf34-4c38-b28a-f02c4a277652","Type":"ContainerDied","Data":"db1e03bee9b6ee8de46928d3ec930886261f27678f9daa3ab87baad8810b4790"} Jul 22 13:33:21.338331 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:21.338257 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" event={"ID":"c52ade64-cf34-4c38-b28a-f02c4a277652","Type":"ContainerStarted","Data":"03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464"} Jul 22 13:33:22.484900 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:22.484871 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:22.534991 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:22.534953 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca\") pod \"c52ade64-cf34-4c38-b28a-f02c4a277652\" (UID: \"c52ade64-cf34-4c38-b28a-f02c4a277652\") " Jul 22 13:33:22.535292 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:22.535268 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c52ade64-cf34-4c38-b28a-f02c4a277652" (UID: "c52ade64-cf34-4c38-b28a-f02c4a277652"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:33:22.636017 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:22.635930 2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c52ade64-cf34-4c38-b28a-f02c4a277652-maas-api-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:33:23.350818 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:23.350785 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" event={"ID":"c52ade64-cf34-4c38-b28a-f02c4a277652","Type":"ContainerDied","Data":"03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464"} Jul 22 13:33:23.350818 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:23.350810 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf" Jul 22 13:33:23.351029 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:23.350832 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f9334cbc40a255423ec518f7387a3a3b45b1dba096429653c73a7c99207464" Jul 22 13:33:30.500757 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:30.500721 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:35.008739 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:35.008693 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:35.010247 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:35.010222 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf"] Jul 22 13:33:35.012767 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:35.012744 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa3ea2-9b2bf"] Jul 22 13:33:35.417634 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:35.417549 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:36.555740 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:36.555708 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c52ade64-cf34-4c38-b28a-f02c4a277652" path="/var/lib/kubelet/pods/c52ade64-cf34-4c38-b28a-f02c4a277652/volumes" Jul 22 13:33:41.610819 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:41.610788 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:42.013400 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:42.013369 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:42.113609 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:42.113569 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:42.341938 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:42.341854 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:42.556838 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:42.556796 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:42.926462 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:42.926428 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:43.247131 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:43.247039 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:43.966301 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:43.966272 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.108847 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.108790 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.197531 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.197496 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.267011 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.266981 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.369931 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.369847 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.761628 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.761601 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:46.856246 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:46.856209 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:50.653321 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:50.653287 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:50.732782 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:50.732752 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:33:50.748395 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:50.748371 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:33:51.147682 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:51.147652 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:51.477651 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:51.477564 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:52.218718 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:52.218687 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:54.967337 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:54.967310 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:55.067169 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:55.067131 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:55.167382 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:55.167343 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:55.269878 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:55.269843 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:33:58.854810 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:33:58.854773 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:07.010614 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.010580 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t"] Jul 22 13:34:07.011085 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.011070 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c52ade64-cf34-4c38-b28a-f02c4a277652" containerName="revoke-keys" Jul 22 13:34:07.011137 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.011090 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c52ade64-cf34-4c38-b28a-f02c4a277652" containerName="revoke-keys" Jul 22 13:34:07.011172 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.011158 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c52ade64-cf34-4c38-b28a-f02c4a277652" containerName="revoke-keys" Jul 22 13:34:07.014506 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.014483 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:07.016981 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.016963 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bpvdk\"" Jul 22 13:34:07.026315 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.025296 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t"] Jul 22 13:34:07.042362 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.042327 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-609ebe-jz65t\" (UID: \"dfa5cbbf-dc50-4fe6-af51-63707a702f1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:07.143845 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.143806 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-609ebe-jz65t\" (UID: \"dfa5cbbf-dc50-4fe6-af51-63707a702f1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:07.144467 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.144442 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-609ebe-jz65t\" (UID: \"dfa5cbbf-dc50-4fe6-af51-63707a702f1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:07.327490 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.327391 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:07.470550 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.470510 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t"] Jul 22 13:34:07.473613 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:34:07.473585 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa5cbbf_dc50_4fe6_af51_63707a702f1a.slice/crio-99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb WatchSource:0}: Error finding container 99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb: Status 404 returned error can't find the container with id 99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb Jul 22 13:34:07.585401 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.585271 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:07.601465 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.601431 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" event={"ID":"dfa5cbbf-dc50-4fe6-af51-63707a702f1a","Type":"ContainerStarted","Data":"99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb"} Jul 22 13:34:07.686141 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:07.686081 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:08.609013 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:08.608976 2549 generic.go:356] "Generic (PLEG): container finished" podID="dfa5cbbf-dc50-4fe6-af51-63707a702f1a" containerID="977e03ec3ad18fb7362cf92346b7d587638aac3110d1851680e5568303b0082f" exitCode=0 Jul 22 13:34:08.609413 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:08.609067 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" event={"ID":"dfa5cbbf-dc50-4fe6-af51-63707a702f1a","Type":"ContainerDied","Data":"977e03ec3ad18fb7362cf92346b7d587638aac3110d1851680e5568303b0082f"} Jul 22 13:34:09.761578 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:09.761548 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:09.868842 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:09.868745 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca\") pod \"dfa5cbbf-dc50-4fe6-af51-63707a702f1a\" (UID: \"dfa5cbbf-dc50-4fe6-af51-63707a702f1a\") " Jul 22 13:34:09.869107 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:09.869085 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfa5cbbf-dc50-4fe6-af51-63707a702f1a" (UID: "dfa5cbbf-dc50-4fe6-af51-63707a702f1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:34:09.970221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:09.970189 2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfa5cbbf-dc50-4fe6-af51-63707a702f1a-maas-api-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:34:10.621989 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:10.621960 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" Jul 22 13:34:10.622152 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:10.621990 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t" event={"ID":"dfa5cbbf-dc50-4fe6-af51-63707a702f1a","Type":"ContainerDied","Data":"99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb"} Jul 22 13:34:10.622152 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:10.622036 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99ddd04f5008a455d80c383c893432a0fa72ca454bb55349c8cdfc8b17362feb" Jul 22 13:34:16.037578 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:16.037460 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:16.141948 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:16.141917 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:17.771025 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:17.770978 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:17.871133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:17.871084 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:23.081775 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:23.081741 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:27.114161 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:27.114115 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:27.123287 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:27.123262 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t"] Jul 22 13:34:27.129062 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:27.129041 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-609ebe-jz65t"] Jul 22 13:34:27.544386 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:27.544358 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:28.556310 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:28.556273 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa5cbbf-dc50-4fe6-af51-63707a702f1a" path="/var/lib/kubelet/pods/dfa5cbbf-dc50-4fe6-af51-63707a702f1a/volumes" Jul 22 13:34:34.172085 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:34.172044 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:34.273537 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:34.273475 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:34.540276 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:34.540243 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:34.749893 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:34.749861 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:35.443367 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:35.443338 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:35.539465 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:35.539431 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:50.337170 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:50.337131 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:54.945330 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:54.945290 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:34:56.547656 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:34:56.547610 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:01.866161 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:01.866124 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:01.965685 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:01.965650 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:02.058271 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:02.058228 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:02.287898 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:02.287864 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:02.683366 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:02.683281 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:02.984599 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:02.984376 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:03.180453 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:03.180418 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:05.703800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:05.703755 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:05.804918 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:05.804878 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:06.013165 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:06.013131 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:06.476096 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:06.476014 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:06.699579 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:06.699547 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:06.800395 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:06.800365 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:10.219796 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:10.219767 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:10.584123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:10.584089 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:10.920575 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:10.920482 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:11.020441 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:11.020408 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:13.126624 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:13.126588 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:13.233939 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:13.233913 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:13.767756 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:13.767718 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:13.889436 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:13.889405 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:13.989059 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:13.989014 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:14.492127 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:14.492090 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:14.592555 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:14.592500 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:14.723505 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:14.723475 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:18.278979 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:18.278945 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:27.396229 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:27.396191 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:27.505804 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:27.505767 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:28.855714 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:28.855680 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:28.954284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:28.954247 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:30.675940 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:30.675901 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:35.333588 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:35.333549 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:35.436490 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:35.436458 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:35:53.501396 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:35:53.501312 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:37:49.085221 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:37:49.085189 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:37:50.832287 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:37:50.832258 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:37:58.227148 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:37:58.227116 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:38:00.198423 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:38:00.198388 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:38:48.687786 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:38:48.687690 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:38:50.775331 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:38:50.775304 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:38:50.791412 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:38:50.791389 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:39:33.064293 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:33.064239 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:39:34.008241 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:34.008195 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:39:42.386327 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:42.386287 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:39:50.863501 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:50.863466 2549 scope.go:117] "RemoveContainer" containerID="db1e03bee9b6ee8de46928d3ec930886261f27678f9daa3ab87baad8810b4790" Jul 22 13:39:50.872282 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:50.872261 2549 scope.go:117] "RemoveContainer" containerID="53e6207d85b964ab7b6effdd05081b39f53f2ffbc99daec14a9ff40fb5e76008" Jul 22 13:39:59.572601 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:59.572566 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:39:59.632211 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:39:59.632185 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:08.890972 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:08.890941 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:28.367714 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:28.367627 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:28.468071 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:28.468041 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:29.835286 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:29.835255 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:29.936000 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:29.935968 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:36.110726 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:36.110683 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:36.209778 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:36.209744 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:48.752109 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:48.752077 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:49.694701 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:49.694666 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:40:50.650618 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.650589 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-139621252667952"] Jul 22 13:40:50.651017 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.651003 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa5cbbf-dc50-4fe6-af51-63707a702f1a" containerName="revoke-keys" Jul 22 13:40:50.651063 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.651018 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa5cbbf-dc50-4fe6-af51-63707a702f1a" containerName="revoke-keys" Jul 22 13:40:50.651098 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.651090 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa5cbbf-dc50-4fe6-af51-63707a702f1a" containerName="revoke-keys" Jul 22 13:40:50.654265 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.654249 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:50.656850 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.656827 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4ljcl\"" Jul 22 13:40:50.660284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.660259 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pctmg\" (UniqueName: \"kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg\") pod \"test-curl-7509-139621252667952\" (UID: \"66c96dcc-77e1-43ab-960a-f7e2d5e2af50\") " pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:50.661656 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.661632 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252667952"] Jul 22 13:40:50.761109 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.761080 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pctmg\" (UniqueName: \"kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg\") pod \"test-curl-7509-139621252667952\" (UID: \"66c96dcc-77e1-43ab-960a-f7e2d5e2af50\") " pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:50.771660 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.771632 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pctmg\" (UniqueName: \"kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg\") pod \"test-curl-7509-139621252667952\" (UID: \"66c96dcc-77e1-43ab-960a-f7e2d5e2af50\") " pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:50.899846 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.899815 2549 scope.go:117] "RemoveContainer" containerID="977e03ec3ad18fb7362cf92346b7d587638aac3110d1851680e5568303b0082f" Jul 22 13:40:50.965034 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:50.965006 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:51.101774 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:51.101747 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252667952"] Jul 22 13:40:51.103842 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:40:51.103807 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66c96dcc_77e1_43ab_960a_f7e2d5e2af50.slice/crio-54dcc2d1048df0dc6533cd0a1b2baeed50a7a5887690b3f99b5e9e1a382e81b2 WatchSource:0}: Error finding container 54dcc2d1048df0dc6533cd0a1b2baeed50a7a5887690b3f99b5e9e1a382e81b2: Status 404 returned error can't find the container with id 54dcc2d1048df0dc6533cd0a1b2baeed50a7a5887690b3f99b5e9e1a382e81b2 Jul 22 13:40:51.105630 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:51.105613 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 13:40:51.929530 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:51.929486 2549 generic.go:356] "Generic (PLEG): container finished" podID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" containerID="67bf2e4584ac067461af02f481ab8030a3b0e539394b72646dd8d9effdbd6fca" exitCode=0 Jul 22 13:40:51.929884 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:51.929559 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252667952" event={"ID":"66c96dcc-77e1-43ab-960a-f7e2d5e2af50","Type":"ContainerDied","Data":"67bf2e4584ac067461af02f481ab8030a3b0e539394b72646dd8d9effdbd6fca"} Jul 22 13:40:51.929884 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:51.929592 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252667952" event={"ID":"66c96dcc-77e1-43ab-960a-f7e2d5e2af50","Type":"ContainerStarted","Data":"54dcc2d1048df0dc6533cd0a1b2baeed50a7a5887690b3f99b5e9e1a382e81b2"} Jul 22 13:40:53.073781 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.073757 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:53.077808 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.077784 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pctmg\" (UniqueName: \"kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg\") pod \"66c96dcc-77e1-43ab-960a-f7e2d5e2af50\" (UID: \"66c96dcc-77e1-43ab-960a-f7e2d5e2af50\") " Jul 22 13:40:53.079754 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.079730 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg" (OuterVolumeSpecName: "kube-api-access-pctmg") pod "66c96dcc-77e1-43ab-960a-f7e2d5e2af50" (UID: "66c96dcc-77e1-43ab-960a-f7e2d5e2af50"). InnerVolumeSpecName "kube-api-access-pctmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:40:53.097454 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.097434 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-139621252667952_66c96dcc-77e1-43ab-960a-f7e2d5e2af50/test-curl-7509-139621252667952/0.log" Jul 22 13:40:53.126219 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.126183 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-139621252667952"] Jul 22 13:40:53.130620 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.130600 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-139621252667952"] Jul 22 13:40:53.179124 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.179097 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pctmg\" (UniqueName: \"kubernetes.io/projected/66c96dcc-77e1-43ab-960a-f7e2d5e2af50-kube-api-access-pctmg\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:40:53.941701 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.941672 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54dcc2d1048df0dc6533cd0a1b2baeed50a7a5887690b3f99b5e9e1a382e81b2" Jul 22 13:40:53.941701 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:53.941673 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:53.951808 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:40:53.951782 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7509-139621252667952\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" pod="opendatahub/test-curl-7509-139621252667952" Jul 22 13:40:54.555005 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:54.554975 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" path="/var/lib/kubelet/pods/66c96dcc-77e1-43ab-960a-f7e2d5e2af50/volumes" Jul 22 13:40:56.864663 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.864627 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-139621252580384"] Jul 22 13:40:56.865100 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.865087 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" containerName="test-curl-7509-139621252667952" Jul 22 13:40:56.865100 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.865101 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" containerName="test-curl-7509-139621252667952" Jul 22 13:40:56.865181 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.865173 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c96dcc-77e1-43ab-960a-f7e2d5e2af50" containerName="test-curl-7509-139621252667952" Jul 22 13:40:56.868353 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.868338 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:56.870995 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.870975 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4ljcl\"" Jul 22 13:40:56.873965 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.873938 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252580384"] Jul 22 13:40:56.913046 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:56.913007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8fxq\" (UniqueName: \"kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq\") pod \"test-curl-7509-139621252580384\" (UID: \"ecc56430-2ff3-493c-8c5b-1817fe40c5c6\") " pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:57.014494 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.014456 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8fxq\" (UniqueName: \"kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq\") pod \"test-curl-7509-139621252580384\" (UID: \"ecc56430-2ff3-493c-8c5b-1817fe40c5c6\") " pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:57.025859 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.025833 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8fxq\" (UniqueName: \"kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq\") pod \"test-curl-7509-139621252580384\" (UID: \"ecc56430-2ff3-493c-8c5b-1817fe40c5c6\") " pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:57.180087 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.180002 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:57.325686 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.321555 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252580384"] Jul 22 13:40:57.325956 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:40:57.325925 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecc56430_2ff3_493c_8c5b_1817fe40c5c6.slice/crio-4ed66fc3f30099d07e3bb6a74556ae62bff0ebad05612ad879d50f55816b8812 WatchSource:0}: Error finding container 4ed66fc3f30099d07e3bb6a74556ae62bff0ebad05612ad879d50f55816b8812: Status 404 returned error can't find the container with id 4ed66fc3f30099d07e3bb6a74556ae62bff0ebad05612ad879d50f55816b8812 Jul 22 13:40:57.966472 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.966376 2549 generic.go:356] "Generic (PLEG): container finished" podID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" containerID="4d9a05320cbdafd2641aaad047bdb4037decbf1d5bc9372981b6a980d18951c6" exitCode=0 Jul 22 13:40:57.966472 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.966460 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252580384" event={"ID":"ecc56430-2ff3-493c-8c5b-1817fe40c5c6","Type":"ContainerDied","Data":"4d9a05320cbdafd2641aaad047bdb4037decbf1d5bc9372981b6a980d18951c6"} Jul 22 13:40:57.966922 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:57.966498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252580384" event={"ID":"ecc56430-2ff3-493c-8c5b-1817fe40c5c6","Type":"ContainerStarted","Data":"4ed66fc3f30099d07e3bb6a74556ae62bff0ebad05612ad879d50f55816b8812"} Jul 22 13:40:59.126972 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.126948 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:59.151799 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.151771 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-139621252580384_ecc56430-2ff3-493c-8c5b-1817fe40c5c6/test-curl-7509-139621252580384/0.log" Jul 22 13:40:59.179990 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.179952 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-139621252580384"] Jul 22 13:40:59.185506 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.185435 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-139621252580384"] Jul 22 13:40:59.236827 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.236775 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8fxq\" (UniqueName: \"kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq\") pod \"ecc56430-2ff3-493c-8c5b-1817fe40c5c6\" (UID: \"ecc56430-2ff3-493c-8c5b-1817fe40c5c6\") " Jul 22 13:40:59.238796 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.238771 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq" (OuterVolumeSpecName: "kube-api-access-t8fxq") pod "ecc56430-2ff3-493c-8c5b-1817fe40c5c6" (UID: "ecc56430-2ff3-493c-8c5b-1817fe40c5c6"). InnerVolumeSpecName "kube-api-access-t8fxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 13:40:59.338320 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.338287 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8fxq\" (UniqueName: \"kubernetes.io/projected/ecc56430-2ff3-493c-8c5b-1817fe40c5c6-kube-api-access-t8fxq\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:40:59.977703 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.977675 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ed66fc3f30099d07e3bb6a74556ae62bff0ebad05612ad879d50f55816b8812" Jul 22 13:40:59.977703 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:40:59.977705 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:40:59.988238 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:40:59.988211 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7509-139621252580384\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:41:00.556111 ip-10-0-134-155 kubenswrapper[2549]: E0722 13:41:00.556078 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7509-139621252580384\" is forbidden: User \"system:node:ip-10-0-134-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-155.ec2.internal' and this object" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" pod="opendatahub/test-curl-7509-139621252580384" Jul 22 13:41:00.557284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:00.557261 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" path="/var/lib/kubelet/pods/ecc56430-2ff3-493c-8c5b-1817fe40c5c6/volumes" Jul 22 13:41:03.300928 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:03.300892 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:07.533274 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.533234 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj"] Jul 22 13:41:07.533715 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.533698 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" containerName="test-curl-7509-139621252580384" Jul 22 13:41:07.533760 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.533716 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" containerName="test-curl-7509-139621252580384" Jul 22 13:41:07.533809 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.533799 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc56430-2ff3-493c-8c5b-1817fe40c5c6" containerName="test-curl-7509-139621252580384" Jul 22 13:41:07.539457 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.539439 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:07.542320 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.542292 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bpvdk\"" Jul 22 13:41:07.544928 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.544904 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj"] Jul 22 13:41:07.615610 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.615574 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj\" (UID: \"292f9c7e-914b-4a67-b50e-812e775b635a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:07.716232 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.716194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj\" (UID: \"292f9c7e-914b-4a67-b50e-812e775b635a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:07.716924 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.716897 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj\" (UID: \"292f9c7e-914b-4a67-b50e-812e775b635a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:07.852499 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.852418 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:07.991548 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:07.991500 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj"] Jul 22 13:41:07.994630 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:41:07.994596 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292f9c7e_914b_4a67_b50e_812e775b635a.slice/crio-b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff WatchSource:0}: Error finding container b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff: Status 404 returned error can't find the container with id b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff Jul 22 13:41:08.026762 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:08.026736 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" event={"ID":"292f9c7e-914b-4a67-b50e-812e775b635a","Type":"ContainerStarted","Data":"b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff"} Jul 22 13:41:08.240975 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:08.240940 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:08.341433 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:08.341403 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:09.034245 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:09.034157 2549 generic.go:356] "Generic (PLEG): container finished" podID="292f9c7e-914b-4a67-b50e-812e775b635a" containerID="2fb149f0573816b3b37e78835ace0fc94dbb2a267500e1e95d9d462b385b1e0f" exitCode=0 Jul 22 13:41:09.034635 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:09.034253 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" event={"ID":"292f9c7e-914b-4a67-b50e-812e775b635a","Type":"ContainerDied","Data":"2fb149f0573816b3b37e78835ace0fc94dbb2a267500e1e95d9d462b385b1e0f"} Jul 22 13:41:10.186434 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:10.186406 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:10.239717 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:10.239688 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca\") pod \"292f9c7e-914b-4a67-b50e-812e775b635a\" (UID: \"292f9c7e-914b-4a67-b50e-812e775b635a\") " Jul 22 13:41:10.240046 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:10.240022 2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "292f9c7e-914b-4a67-b50e-812e775b635a" (UID: "292f9c7e-914b-4a67-b50e-812e775b635a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 13:41:10.340727 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:10.340650 2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292f9c7e-914b-4a67-b50e-812e775b635a-maas-api-service-ca\") on node \"ip-10-0-134-155.ec2.internal\" DevicePath \"\"" Jul 22 13:41:11.046812 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:11.046780 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" Jul 22 13:41:11.046996 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:11.046810 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj" event={"ID":"292f9c7e-914b-4a67-b50e-812e775b635a","Type":"ContainerDied","Data":"b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff"} Jul 22 13:41:11.046996 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:11.046864 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5b5bd3848be3b4f46fe590a3fc48cbd62d9634a7be0b0a789da834fa549bbff" Jul 22 13:41:17.982277 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:17.982243 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:22.618216 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:22.618179 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:22.633604 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:22.633574 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj"] Jul 22 13:41:22.637009 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:22.636969 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-15ce38-wjfnj"] Jul 22 13:41:23.024660 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:23.024627 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:24.555610 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:24.555576 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292f9c7e-914b-4a67-b50e-812e775b635a" path="/var/lib/kubelet/pods/292f9c7e-914b-4a67-b50e-812e775b635a/volumes" Jul 22 13:41:29.314991 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:29.314957 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:29.415775 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:29.415739 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:29.603676 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:29.603597 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:29.841333 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:29.841301 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:30.634686 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:30.634653 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:30.737077 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:30.737046 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:33.267183 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:33.267154 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:41.205187 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:41.205153 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:45.036220 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:45.036140 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:45.427252 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:45.427174 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:48.274097 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:48.274061 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:51.940753 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:51.940720 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:52.041238 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:52.041202 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:52.231759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:52.231680 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:52.469675 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:52.469633 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:41:58.586784 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:58.586747 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-526rq_a6e81bf4-8de4-4671-b519-8e33364d91cf/manager/0.log" Jul 22 13:41:58.716234 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:58.716205 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8zl5q_82454252-c2e0-4be2-a17f-006abc732240/manager/0.log" Jul 22 13:41:58.838136 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:58.838053 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5878d9c5b5-t4b74_20c58a5a-d7a2-4a4a-b6ff-4380f97cd926/manager/0.log" Jul 22 13:41:58.961891 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:58.961867 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w4cwf_eda77214-6afe-4b53-a8be-08a33f6df1f9/server/0.log" Jul 22 13:41:59.080467 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:59.080434 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2tkdh_49440fbd-5054-47ec-b63a-84417edee6c1/manager/0.log" Jul 22 13:41:59.336284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:59.336254 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-bzgnq_81a6220c-7939-4a12-88f7-4322be4e66d6/copy-manifests/0.log" Jul 22 13:41:59.344728 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:59.344709 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-bzgnq_81a6220c-7939-4a12-88f7-4322be4e66d6/manager/0.log" Jul 22 13:41:59.846759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:41:59.846728 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7878758c66-4ctfr_3ac9c437-aafa-4315-84d5-71b1bb9742d4/maas-api/0.log" Jul 22 13:42:00.199831 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:00.199758 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-lvqrd_56e15005-74b9-467e-ab5d-c52abaa8c878/postgres/0.log" Jul 22 13:42:01.021198 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.021171 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/util/0.log" Jul 22 13:42:01.029145 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.029125 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/pull/0.log" Jul 22 13:42:01.036942 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.036925 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/extract/0.log" Jul 22 13:42:01.158292 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.158264 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/util/0.log" Jul 22 13:42:01.168250 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.168217 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/pull/0.log" Jul 22 13:42:01.176025 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.176008 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/extract/0.log" Jul 22 13:42:01.291203 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.291117 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/pull/0.log" Jul 22 13:42:01.298710 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.298687 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/extract/0.log" Jul 22 13:42:01.306150 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.306132 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/util/0.log" Jul 22 13:42:01.425809 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.425784 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/util/0.log" Jul 22 13:42:01.434092 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.434057 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/pull/0.log" Jul 22 13:42:01.442060 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:01.442037 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/extract/0.log" Jul 22 13:42:02.201943 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:02.201915 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2kwmt_0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba/manager/0.log" Jul 22 13:42:02.467028 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:02.466956 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8n9kp_528a7cff-612a-4d82-b94f-6cc4a783fcd5/manager/0.log" Jul 22 13:42:02.961168 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:02.961142 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmsxg_b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf/discovery/0.log" Jul 22 13:42:03.188667 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:03.188641 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767b4d54f8-r974b_2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3/kube-auth-proxy/0.log" Jul 22 13:42:03.439923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:03.439892 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97sft_fd3a9fb6-d6e4-4843-9a1e-c01b14664f13/payload-pre-processing/0.log" Jul 22 13:42:03.559312 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:03.559279 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tl5zh_d8285281-9c99-40ad-9c4f-1d7d78a8e680/payload-processing/0.log" Jul 22 13:42:03.677360 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:03.677326 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6d8b6fd8-5cgh2_545a4991-ecee-4898-b378-9b5d22d2b40e/router/0.log" Jul 22 13:42:04.029533 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:04.029494 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6frwx_b5270531-2a1d-4417-a542-9e8f3415fc9b/main/0.log" Jul 22 13:42:10.069291 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:10.069260 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:42:10.174231 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:10.174202 2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" limit=1024 Jul 22 13:42:14.651670 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:14.651642 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6hcl6_ca56356c-b33f-4ca5-b2a9-0bcdd66fc141/global-pull-secret-syncer/0.log" Jul 22 13:42:14.706184 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:14.706144 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bfkv8_ac76a3f1-3c25-499c-975d-af2dc2be92eb/konnectivity-agent/0.log" Jul 22 13:42:14.823934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:14.823901 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-155.ec2.internal_6c0c76ea43c26f235062bbc97e0861a1/haproxy/0.log" Jul 22 13:42:18.420168 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.420126 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/extract/0.log" Jul 22 13:42:18.457564 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.457541 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/util/0.log" Jul 22 13:42:18.486840 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.486812 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zxs88_44165e4f-f5bb-4723-a6e0-5feea5877f7b/pull/0.log" Jul 22 13:42:18.523640 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.523589 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/extract/0.log" Jul 22 13:42:18.557528 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.557494 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/util/0.log" Jul 22 13:42:18.588624 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.588601 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ql7q5_4c0b8b0d-4443-4faa-99f0-d814d305d06a/pull/0.log" Jul 22 13:42:18.630340 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.630320 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/extract/0.log" Jul 22 13:42:18.659434 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.659409 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/util/0.log" Jul 22 13:42:18.685861 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.685797 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lx9j2_8c4d9ffd-8908-4212-8e99-008d306e815d/pull/0.log" Jul 22 13:42:18.721651 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.721622 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/extract/0.log" Jul 22 13:42:18.752492 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.752467 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/util/0.log" Jul 22 13:42:18.781414 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:18.781391 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cs88t_2f83e83d-7a0f-4f7c-8462-e1b45f1f0f9a/pull/0.log" Jul 22 13:42:19.631259 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:19.631228 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2kwmt_0720312b-27ae-4eb1-ae4d-d8c4ca97d3ba/manager/0.log" Jul 22 13:42:19.748534 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:19.748493 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8n9kp_528a7cff-612a-4d82-b94f-6cc4a783fcd5/manager/0.log" Jul 22 13:42:21.375534 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.375490 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/alertmanager/0.log" Jul 22 13:42:21.405285 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.405252 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/config-reloader/0.log" Jul 22 13:42:21.438625 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.438581 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/kube-rbac-proxy-web/0.log" Jul 22 13:42:21.481241 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.481194 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/kube-rbac-proxy/0.log" Jul 22 13:42:21.524865 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.524828 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/kube-rbac-proxy-metric/0.log" Jul 22 13:42:21.561858 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.561834 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/prom-label-proxy/0.log" Jul 22 13:42:21.601627 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.601588 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dfbf746d-0e85-4e2b-b82a-7ae9d64d2932/init-config-reloader/0.log" Jul 22 13:42:21.666494 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.666417 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-w22gc_b4d27353-52e1-4e3d-8559-53a0955cdef5/cluster-monitoring-operator/0.log" Jul 22 13:42:21.825539 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.825496 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77c44d85b4-tvqkn_8553a000-ed49-4db2-aebf-54cf68773390/metrics-server/0.log" Jul 22 13:42:21.975404 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:21.975310 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhv5_bea5bbfb-6150-48cf-977a-a3d5807334ee/node-exporter/0.log" Jul 22 13:42:22.013631 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.013606 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhv5_bea5bbfb-6150-48cf-977a-a3d5807334ee/kube-rbac-proxy/0.log" Jul 22 13:42:22.046151 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.046130 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jwhv5_bea5bbfb-6150-48cf-977a-a3d5807334ee/init-textfile/0.log" Jul 22 13:42:22.216309 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.216287 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-25v5x_6fe5233b-fd63-45d7-a7a6-aae64edfd883/kube-rbac-proxy-main/0.log" Jul 22 13:42:22.264114 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.264093 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-25v5x_6fe5233b-fd63-45d7-a7a6-aae64edfd883/kube-rbac-proxy-self/0.log" Jul 22 13:42:22.302759 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.302736 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-25v5x_6fe5233b-fd63-45d7-a7a6-aae64edfd883/openshift-state-metrics/0.log" Jul 22 13:42:22.646204 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.646177 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d849dbbd-b9gjr_c69b961b-dfc2-450e-a58e-13cbc74b4ba6/telemeter-client/0.log" Jul 22 13:42:22.677348 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.677322 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d849dbbd-b9gjr_c69b961b-dfc2-450e-a58e-13cbc74b4ba6/reload/0.log" Jul 22 13:42:22.719601 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:22.719578 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67d849dbbd-b9gjr_c69b961b-dfc2-450e-a58e-13cbc74b4ba6/kube-rbac-proxy/0.log" Jul 22 13:42:24.799301 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:24.799275 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/1.log" Jul 22 13:42:24.803447 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:24.803430 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-697sl_4fff89e9-77bc-4591-b4c2-5d5b36cf8aa9/console-operator/2.log" Jul 22 13:42:25.967923 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:25.967892 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-lhnbv_b58cf61d-cf7b-4991-99c3-18cb4bdacf69/volume-data-source-validator/0.log" Jul 22 13:42:26.561386 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.561353 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6"] Jul 22 13:42:26.561795 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.561782 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f9c7e-914b-4a67-b50e-812e775b635a" containerName="revoke-keys" Jul 22 13:42:26.561844 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.561798 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f9c7e-914b-4a67-b50e-812e775b635a" containerName="revoke-keys" Jul 22 13:42:26.561880 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.561870 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f9c7e-914b-4a67-b50e-812e775b635a" containerName="revoke-keys" Jul 22 13:42:26.565242 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.565221 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.567791 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.567768 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zstf\"/\"openshift-service-ca.crt\"" Jul 22 13:42:26.569043 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.569024 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9zstf\"/\"default-dockercfg-bnjsf\"" Jul 22 13:42:26.569122 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.569024 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zstf\"/\"kube-root-ca.crt\"" Jul 22 13:42:26.583781 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.583755 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6"] Jul 22 13:42:26.642947 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.642917 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-podres\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.643123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.642959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt45m\" (UniqueName: \"kubernetes.io/projected/95c23057-5fcf-49db-89db-50865dcaedc9-kube-api-access-mt45m\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.643123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.642979 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-sys\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.643123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.643091 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-proc\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.643123 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.643126 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-lib-modules\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744595 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744548 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt45m\" (UniqueName: \"kubernetes.io/projected/95c23057-5fcf-49db-89db-50865dcaedc9-kube-api-access-mt45m\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744602 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-sys\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744660 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-proc\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744682 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-lib-modules\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744800 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744742 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-sys\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744961 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744745 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-proc\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744961 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744821 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-podres\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744961 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744888 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-lib-modules\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.744961 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.744893 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95c23057-5fcf-49db-89db-50865dcaedc9-podres\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.754553 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.754533 2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt45m\" (UniqueName: \"kubernetes.io/projected/95c23057-5fcf-49db-89db-50865dcaedc9-kube-api-access-mt45m\") pod \"perf-node-gather-daemonset-th9l6\" (UID: \"95c23057-5fcf-49db-89db-50865dcaedc9\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:26.875699 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:26.875613 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:27.222864 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.222839 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6"] Jul 22 13:42:27.224640 ip-10-0-134-155 kubenswrapper[2549]: W0722 13:42:27.224612 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95c23057_5fcf_49db_89db_50865dcaedc9.slice/crio-52cf6b2d0a01a4d37e27ffbfb48151755fc66112b8deb7e15562caf948de0380 WatchSource:0}: Error finding container 52cf6b2d0a01a4d37e27ffbfb48151755fc66112b8deb7e15562caf948de0380: Status 404 returned error can't find the container with id 52cf6b2d0a01a4d37e27ffbfb48151755fc66112b8deb7e15562caf948de0380 Jul 22 13:42:27.385386 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.385348 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhn78_cbca4457-c725-4b65-b816-02a9b5938f97/dns/0.log" Jul 22 13:42:27.422044 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.422006 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhn78_cbca4457-c725-4b65-b816-02a9b5938f97/kube-rbac-proxy/0.log" Jul 22 13:42:27.458489 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.458454 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xb47_8d55cadd-ccd6-4a92-8850-9a564ea8a2af/dns-node-resolver/0.log" Jul 22 13:42:27.490162 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.490087 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" event={"ID":"95c23057-5fcf-49db-89db-50865dcaedc9","Type":"ContainerStarted","Data":"f78d8e5319dfe2b219babb08a6b822557c53fd5926bcc133967120b68cae792e"} Jul 22 13:42:27.490162 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.490142 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" event={"ID":"95c23057-5fcf-49db-89db-50865dcaedc9","Type":"ContainerStarted","Data":"52cf6b2d0a01a4d37e27ffbfb48151755fc66112b8deb7e15562caf948de0380"} Jul 22 13:42:27.490338 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.490253 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:27.510573 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:27.510528 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" podStartSLOduration=1.510500839 podStartE2EDuration="1.510500839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:42:27.507329662 +0000 UTC m=+2917.393966330" watchObservedRunningTime="2026-07-22 13:42:27.510500839 +0000 UTC m=+2917.397137505" Jul 22 13:42:28.151980 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:28.151952 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8phlh_275096cd-e634-4f35-9ddf-da60999b16c6/node-ca/0.log" Jul 22 13:42:29.400676 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:29.400642 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmsxg_b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf/discovery/0.log" Jul 22 13:42:29.456675 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:29.456645 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767b4d54f8-r974b_2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3/kube-auth-proxy/0.log" Jul 22 13:42:29.563575 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:29.563546 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97sft_fd3a9fb6-d6e4-4843-9a1e-c01b14664f13/payload-pre-processing/0.log" Jul 22 13:42:29.603687 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:29.603658 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tl5zh_d8285281-9c99-40ad-9c4f-1d7d78a8e680/payload-processing/0.log" Jul 22 13:42:29.646864 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:29.646838 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6d8b6fd8-5cgh2_545a4991-ecee-4898-b378-9b5d22d2b40e/router/0.log" Jul 22 13:42:30.405356 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:30.405328 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-khhzp_c083c574-8de8-4c77-b48b-f5c11fea4d4a/serve-healthcheck-canary/0.log" Jul 22 13:42:30.955236 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:30.955202 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7j42r_05fd62ec-ad1e-4655-b4ce-0ee0c544c086/insights-operator/0.log" Jul 22 13:42:30.956383 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:30.956350 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-7j42r_05fd62ec-ad1e-4655-b4ce-0ee0c544c086/insights-operator/1.log" Jul 22 13:42:31.153124 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:31.153077 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rt8gp_0f4596c3-c593-42b8-b3a8-ddb750bd97db/kube-rbac-proxy/0.log" Jul 22 13:42:31.195809 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:31.195778 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rt8gp_0f4596c3-c593-42b8-b3a8-ddb750bd97db/exporter/0.log" Jul 22 13:42:31.235564 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:31.235470 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rt8gp_0f4596c3-c593-42b8-b3a8-ddb750bd97db/extractor/0.log" Jul 22 13:42:33.393284 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.393257 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-526rq_a6e81bf4-8de4-4671-b519-8e33364d91cf/manager/0.log" Jul 22 13:42:33.507120 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.507091 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-th9l6" Jul 22 13:42:33.577703 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.577672 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8zl5q_82454252-c2e0-4be2-a17f-006abc732240/manager/0.log" Jul 22 13:42:33.687934 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.687833 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5878d9c5b5-t4b74_20c58a5a-d7a2-4a4a-b6ff-4380f97cd926/manager/0.log" Jul 22 13:42:33.717582 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.717550 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w4cwf_eda77214-6afe-4b53-a8be-08a33f6df1f9/server/0.log" Jul 22 13:42:33.796276 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.796245 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2tkdh_49440fbd-5054-47ec-b63a-84417edee6c1/manager/0.log" Jul 22 13:42:33.894232 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.894205 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-bzgnq_81a6220c-7939-4a12-88f7-4322be4e66d6/manager/0.log" Jul 22 13:42:33.924814 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:33.924791 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-bzgnq_81a6220c-7939-4a12-88f7-4322be4e66d6/copy-manifests/0.log" Jul 22 13:42:34.804501 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:34.804465 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmsxg_b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf/discovery/0.log" Jul 22 13:42:34.835259 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:34.835237 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767b4d54f8-r974b_2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3/kube-auth-proxy/0.log" Jul 22 13:42:34.915931 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:34.915907 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97sft_fd3a9fb6-d6e4-4843-9a1e-c01b14664f13/payload-pre-processing/0.log" Jul 22 13:42:34.938043 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:34.938018 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tl5zh_d8285281-9c99-40ad-9c4f-1d7d78a8e680/payload-processing/0.log" Jul 22 13:42:34.957579 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:34.957561 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6d8b6fd8-5cgh2_545a4991-ecee-4898-b378-9b5d22d2b40e/router/0.log" Jul 22 13:42:36.448716 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:36.448689 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zmsxg_b4d5cc0d-7b4e-41db-9c69-3fa3a5727eaf/discovery/0.log" Jul 22 13:42:36.502463 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:36.502402 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767b4d54f8-r974b_2cca2a58-35d3-4fd7-b3de-19a14c3f7ef3/kube-auth-proxy/0.log" Jul 22 13:42:36.603208 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:36.603177 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97sft_fd3a9fb6-d6e4-4843-9a1e-c01b14664f13/payload-pre-processing/0.log" Jul 22 13:42:36.626452 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:36.626424 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-tl5zh_d8285281-9c99-40ad-9c4f-1d7d78a8e680/payload-processing/0.log" Jul 22 13:42:36.649635 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:36.649609 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d6d8b6fd8-5cgh2_545a4991-ecee-4898-b378-9b5d22d2b40e/router/0.log" Jul 22 13:42:41.353499 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:41.353469 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9t98t_97119692-c8f1-4c97-ad24-b60a46dde183/kube-storage-version-migrator-operator/1.log" Jul 22 13:42:41.354220 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:41.354192 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9t98t_97119692-c8f1-4c97-ad24-b60a46dde183/kube-storage-version-migrator-operator/0.log" Jul 22 13:42:42.611298 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.611273 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/kube-multus-additional-cni-plugins/0.log" Jul 22 13:42:42.638335 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.638305 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/egress-router-binary-copy/0.log" Jul 22 13:42:42.665150 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.665120 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/cni-plugins/0.log" Jul 22 13:42:42.692886 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.692858 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/bond-cni-plugin/0.log" Jul 22 13:42:42.719133 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.719110 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/routeoverride-cni/0.log" Jul 22 13:42:42.745695 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.745670 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/whereabouts-cni-bincopy/0.log" Jul 22 13:42:42.772693 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:42.772672 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvhmm_2fe25ac5-1751-4f6e-97a3-b7e21a5b7121/whereabouts-cni/0.log" Jul 22 13:42:43.094270 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:43.094242 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w5j5x_5d9a6bbb-9276-4bee-b302-9beb3b774ee7/kube-multus/0.log" Jul 22 13:42:43.222357 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:43.222317 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rht2n_e009cf55-84ed-4825-ab2b-6a218a079da4/network-metrics-daemon/0.log" Jul 22 13:42:43.250975 ip-10-0-134-155 kubenswrapper[2549]: I0722 13:42:43.250951 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rht2n_e009cf55-84ed-4825-ab2b-6a218a079da4/kube-rbac-proxy/0.log"