Jul 06 22:21:55.744562 ip-10-0-138-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 22:21:55.744588 ip-10-0-138-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 22:21:55.744596 ip-10-0-138-135 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 22:21:55.744905 ip-10-0-138-135 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 22:22:05.889986 ip-10-0-138-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 22:22:05.890006 ip-10-0-138-135 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 515a01ad0536437d9b01ed98748bd121 -- Jul 06 22:23:52.466982 ip-10-0-138-135 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:23:52.845127 ip-10-0-138-135 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.845127 ip-10-0-138-135 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:23:52.845127 ip-10-0-138-135 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.845127 ip-10-0-138-135 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:23:52.845127 ip-10-0-138-135 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:23:52.846095 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.846009 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851149 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851166 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851169 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851172 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851175 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.851169 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851177 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851180 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851183 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851186 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851189 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851191 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851195 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851197 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851200 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851203 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851205 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851208 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851210 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851213 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851216 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851218 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851221 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851224 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851226 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851228 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.851386 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851231 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851233 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851236 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851238 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851241 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851244 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851246 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851250 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851252 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851255 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851257 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851259 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851262 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851265 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851269 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851272 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851274 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851277 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851280 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851282 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.851872 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851285 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851288 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851290 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851293 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851295 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851298 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851301 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851306 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851310 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851313 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851316 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851319 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851321 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851324 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851326 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851329 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851332 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851334 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851337 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.852400 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851339 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851342 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851345 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851349 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851352 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851355 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851358 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851363 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851367 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851370 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851373 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851376 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851379 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851381 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851384 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851387 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851390 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851393 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851396 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.852875 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851400 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851403 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851405 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851408 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851411 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851413 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851416 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851418 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851421 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851423 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851426 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851428 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851431 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851433 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851436 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.851438 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852133 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852139 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852142 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852145 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.853361 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852148 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852151 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852154 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852156 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852159 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852161 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852164 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852166 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852169 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852171 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852174 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852176 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852179 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852182 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852185 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852187 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852190 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852192 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852195 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852198 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.853868 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852202 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852205 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852208 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852211 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852213 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852215 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852218 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852220 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852223 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852225 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852228 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852230 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852234 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852237 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852239 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852242 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852244 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852247 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852249 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852252 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.854366 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852254 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852257 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852259 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852262 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852264 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852267 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852270 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852272 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852275 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852278 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852280 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852283 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852285 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852288 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852290 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852293 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852296 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852298 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852301 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852304 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.854905 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852306 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852309 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852311 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852316 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852319 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852322 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852325 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852329 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852332 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852336 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852339 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852342 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852345 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852348 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852350 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852353 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852356 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852359 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852362 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.855389 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852365 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852369 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852371 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852375 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852377 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852380 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852382 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852385 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852388 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852390 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852393 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852395 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852398 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852400 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852403 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852405 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852782 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852788 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852791 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.855858 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852793 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852796 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852799 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852801 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852806 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852809 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852812 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852815 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852817 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852820 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852823 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852825 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852828 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852831 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852834 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852836 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852839 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852841 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852844 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.856313 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852847 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852849 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852852 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852854 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852857 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852859 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852862 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852864 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852867 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852870 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852874 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852876 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852879 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852882 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852885 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852888 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852890 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852893 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852895 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852897 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.856784 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852900 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852903 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852905 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852907 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852910 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852912 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852915 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852918 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852920 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852923 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852925 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852928 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852930 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852933 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852936 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852939 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852941 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852944 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852946 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852948 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.857262 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852952 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852956 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852960 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852963 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852966 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852968 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852971 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852973 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852976 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852978 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852981 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852983 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852987 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852990 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852992 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852995 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.852998 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853001 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853004 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.857811 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853006 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853009 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853012 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853014 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853017 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853020 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853022 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853025 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853027 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853030 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853032 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853035 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853038 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853040 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853043 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853047 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853050 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853052 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853120 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853126 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853133 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:23:52.858276 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853137 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853141 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853144 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853148 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853152 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853155 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853158 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853161 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853164 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853167 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853170 2568 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853173 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853176 2568 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853179 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853182 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853186 2568 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853189 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853194 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853197 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853200 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853203 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853206 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853209 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:23:52.858809 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853212 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853215 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853218 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853222 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853225 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853228 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853232 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853235 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853238 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853240 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853243 2568 flags.go:64] FLAG: --enable-server="true" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853246 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853250 2568 flags.go:64] FLAG: --event-burst="100" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853253 2568 flags.go:64] FLAG: --event-qps="50" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853256 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853259 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853262 2568 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853265 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853268 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853271 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853273 2568 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853276 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853279 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853288 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853291 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:23:52.859371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853293 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853297 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853300 2568 flags.go:64] FLAG: --feature-gates="" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853304 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853307 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853310 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853313 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853316 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853318 2568 flags.go:64] FLAG: --help="false" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853321 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-135.ec2.internal" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853326 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853328 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853331 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853334 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853338 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853340 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853343 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853346 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853349 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853352 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853355 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853357 2568 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853360 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853363 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:23:52.860050 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853366 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853369 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853372 2568 flags.go:64] FLAG: --lock-file="" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853375 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853378 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853380 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853385 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853391 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853394 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853399 2568 flags.go:64] FLAG: --logging-format="text" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853401 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853405 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853407 2568 flags.go:64] FLAG: --manifest-url="" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853410 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853416 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853419 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853423 2568 flags.go:64] FLAG: --max-pods="110" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853426 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853430 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853432 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853436 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853439 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853441 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853444 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853451 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:23:52.860657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853454 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853457 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853460 2568 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853463 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853468 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853471 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853473 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853476 2568 flags.go:64] FLAG: --port="10250" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853479 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853482 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063e1fe4dc77a1804" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853485 2568 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853488 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853491 2568 flags.go:64] FLAG: --register-node="true" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853493 2568 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853497 2568 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853500 2568 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853504 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853507 2568 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853510 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853513 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853516 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853519 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853522 2568 flags.go:64] FLAG: --runonce="false" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853525 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853527 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:23:52.861273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853530 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853535 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853538 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853541 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853544 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853546 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853549 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853552 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853555 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853557 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853560 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853563 2568 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853566 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853571 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853573 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853576 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853582 2568 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853585 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853588 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853590 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853593 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853596 2568 flags.go:64] FLAG: --v="2" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853600 2568 flags.go:64] FLAG: --version="false" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853605 2568 flags.go:64] FLAG: --vmodule="" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853609 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:23:52.861905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.853612 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853733 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853738 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853741 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853744 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853747 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853749 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853752 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853756 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853759 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853762 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853764 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853767 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853769 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853772 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853775 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853778 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853780 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853783 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853785 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.862521 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853788 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853791 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853793 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853796 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853799 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853801 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853804 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853806 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853809 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853811 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853815 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853818 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853821 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853824 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853827 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853829 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853832 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853834 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853837 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853840 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.863208 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853843 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853846 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853848 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853851 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853854 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853856 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853859 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853863 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853866 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853870 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853873 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853876 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853879 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853882 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853885 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853888 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853890 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853893 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853896 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.863703 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853898 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853901 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853903 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853909 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853912 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853915 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853918 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853921 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853923 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853926 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853929 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853932 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853935 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853941 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853944 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853946 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853949 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853952 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853955 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.864218 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853958 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853960 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853962 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853965 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853968 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853970 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853973 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853975 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853978 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853980 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853983 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853985 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853988 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853991 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853993 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.853996 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854000 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854002 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854005 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.864680 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854015 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854017 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.854020 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.854781 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.861150 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.861167 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.862686 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.862695 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862775 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862781 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862784 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862789 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862793 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862796 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.865156 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862799 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862802 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862804 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862807 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862810 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862812 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862815 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862818 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862821 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862823 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862826 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862828 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862831 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862833 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862836 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862839 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862841 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862843 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862846 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862849 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.865501 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862852 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862854 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862857 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862860 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862862 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862865 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862867 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862870 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862872 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862875 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862877 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862880 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862882 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862885 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862888 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862892 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862894 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862897 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862899 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862902 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.865994 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862904 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862907 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862909 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862912 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862915 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862917 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862920 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862923 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862925 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862928 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862930 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862933 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862935 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862938 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862940 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862943 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862953 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862958 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862961 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.866482 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862964 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862967 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862969 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862972 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862974 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862977 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862979 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862982 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862984 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862987 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862989 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862992 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862994 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.862997 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863000 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863002 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863004 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863007 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863009 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863012 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.867009 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863015 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863017 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863019 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863022 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863024 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863027 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863029 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863032 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863034 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863037 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863045 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863047 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863050 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863052 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.863057 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.867484 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863190 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863195 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863199 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863203 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863206 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863209 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863211 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863214 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863217 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863220 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863223 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863226 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863228 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863231 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863234 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863236 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863239 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863241 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863244 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:23:52.867864 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863246 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863249 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863251 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863253 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863256 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863258 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863261 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863263 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863265 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863273 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863276 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863279 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863281 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863283 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863286 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863288 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863291 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863293 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863296 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863298 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:23:52.868319 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863301 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863303 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863305 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863308 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863311 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863313 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863316 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863318 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863320 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863323 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863326 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863328 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863331 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863333 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863335 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863339 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863342 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863345 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863348 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:23:52.868807 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863351 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863353 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863356 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863364 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863367 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863370 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863373 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863375 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863378 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863380 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863383 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863385 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863388 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863390 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863392 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863395 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863399 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863402 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863404 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863407 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:23:52.869249 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863409 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863412 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863415 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863417 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863420 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863422 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863425 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863427 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863430 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863433 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863436 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863438 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863441 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863443 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863445 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863448 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863456 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863459 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863461 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:23:52.869743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863463 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:52.863466 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.863471 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.863603 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.865583 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.866954 2568 server.go:1019] "Starting client certificate rotation" Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.867075 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.867104 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:23:52.870199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.869416 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:23:52.871285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.871256 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:23:52.880833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.880813 2568 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:23:52.882615 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.882603 2568 log.go:25] "Validated CRI v1 image API" Jul 06 22:23:52.886105 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.886087 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:23:52.889858 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.889838 2568 fs.go:135] Filesystem UUIDs: map[0bb03770-9bb6-4e08-955e-ea1588f5b3b2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f9118a6d-7289-419f-8ab6-dec92d4cc1ac:/dev/nvme0n1p4] Jul 06 22:23:52.889920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.889857 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:23:52.895493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.895392 2568 manager.go:216] Machine: {Timestamp:2026-07-06 22:23:52.894216603 +0000 UTC m=+0.318103294 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099505 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25097cc74a46a2fc9e928d9ae05ca7 SystemUUID:ec25097c-c74a-46a2-fc9e-928d9ae05ca7 BootID:515a01ad-0536-437d-9b01-ed98748bd121 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:4e:d2:ed:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:4e:d2:ed:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:f0:87:21:a2:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:23:52.895493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.895485 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:23:52.895619 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.895554 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:23:52.896532 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.896503 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:23:52.896674 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.896533 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:23:52.896768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.896661 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:23:52.897173 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.897162 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:23:52.897215 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.897176 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:23:52.897215 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.897183 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:23:52.897804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.897793 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:23:52.898916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.898906 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:23:52.901405 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901393 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:23:52.901539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901530 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:23:52.901570 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901558 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:23:52.901570 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901567 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:23:52.901621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901580 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:23:52.901621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901590 2568 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:23:52.901621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901598 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:23:52.901909 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901897 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:23:52.901946 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.901921 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:23:52.904530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.904510 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:23:52.906516 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.906502 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:23:52.906585 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.906532 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:23:52.907639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907628 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907644 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907650 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907655 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907663 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907668 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907675 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:23:52.907679 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907680 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:23:52.907901 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907687 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:23:52.907901 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907692 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:23:52.907901 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907700 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:23:52.907901 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.907705 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:23:52.908431 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.908420 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:23:52.908431 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.908430 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:23:52.911202 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.911189 2568 server.go:1268] "Started kubelet" Jul 06 22:23:52.911340 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.911295 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:23:52.911379 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.911360 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:23:52.911890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.911652 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:23:52.912008 ip-10-0-138-135 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:23:52.916390 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.916362 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:23:52.917343 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.917300 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 22:23:52.917444 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.917338 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 22:23:52.917503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.917479 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 22:23:52.917823 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.917793 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:23:52.918121 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.918107 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:23:52.920748 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.919937 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-135.ec2.internal.18bfd3995166f0f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-135.ec2.internal,UID:ip-10-0-138-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-135.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.911163638 +0000 UTC m=+0.335050329,LastTimestamp:2026-07-06 22:23:52.911163638 +0000 UTC m=+0.335050329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-135.ec2.internal,}" Jul 06 22:23:52.922381 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.922365 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:23:52.922447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.922422 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:23:52.922499 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.922450 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:52.923046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923023 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:23:52.923046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923031 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:23:52.923188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923076 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:23:52.923188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923140 2568 factory.go:55] Registering systemd factory Jul 06 22:23:52.923188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923155 2568 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:23:52.923358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923191 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:23:52.923358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923200 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:23:52.923358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923324 2568 factory.go:153] Registering CRI-O factory Jul 06 22:23:52.923358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923337 2568 factory.go:223] Registration of the crio container factory successfully Jul 06 22:23:52.923513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923386 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:23:52.923513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923407 2568 factory.go:103] Registering Raw factory Jul 06 22:23:52.923513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923419 2568 manager.go:1196] Started watching for new ooms in manager Jul 06 22:23:52.923722 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.923696 2568 manager.go:349] Starting recovery of all containers Jul 06 22:23:52.924802 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.924782 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 22:23:52.925256 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.925222 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 22:23:52.934180 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.934163 2568 manager.go:354] Recovery completed Jul 06 22:23:52.935358 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.935333 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 22:23:52.938266 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.938254 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:52.939946 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.939916 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:52.940017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.939959 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:52.940017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.939974 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:52.940467 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.940453 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:23:52.940467 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.940468 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:23:52.940545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.940486 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:23:52.940545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.940456 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:52.941147 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941133 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:52.941202 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941157 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:52.941202 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941166 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:52.941578 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941568 2568 policy_none.go:49] "None policy: Start" Jul 06 22:23:52.941608 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941583 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:23:52.941608 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.941593 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:23:52.942132 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.942071 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-135.ec2.internal.18bfd399531e1981 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-135.ec2.internal,UID:ip-10-0-138-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-135.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.939944321 +0000 UTC m=+0.363831019,LastTimestamp:2026-07-06 22:23:52.939944321 +0000 UTC m=+0.363831019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-135.ec2.internal,}" Jul 06 22:23:52.942520 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.942509 2568 policy_none.go:47] "Start" Jul 06 22:23:52.953902 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.953827 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-135.ec2.internal.18bfd399531e6e10 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-135.ec2.internal,UID:ip-10-0-138-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-135.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-135.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.939965968 +0000 UTC m=+0.363852660,LastTimestamp:2026-07-06 22:23:52.939965968 +0000 UTC m=+0.363852660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-135.ec2.internal,}" Jul 06 22:23:52.964868 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.964724 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-135.ec2.internal.18bfd399531ea331 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-135.ec2.internal,UID:ip-10-0-138-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-135.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-135.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.939979569 +0000 UTC m=+0.363866261,LastTimestamp:2026-07-06 22:23:52.939979569 +0000 UTC m=+0.363866261,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-135.ec2.internal,}" Jul 06 22:23:52.968115 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.968095 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tbbsp" Jul 06 22:23:52.978877 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.978859 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tbbsp" Jul 06 22:23:52.979287 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979273 2568 manager.go:337] "Starting Device Plugin manager" Jul 06 22:23:52.979367 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.979310 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:23:52.979367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979322 2568 server.go:87] "Starting device plugin registration server" Jul 06 22:23:52.979541 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979528 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:23:52.979596 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979543 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:23:52.979641 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979625 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:23:52.979745 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979728 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:23:52.979745 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:52.979740 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:23:52.980204 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.980187 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:23:52.980281 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.980235 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:52.980813 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:52.980759 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-135.ec2.internal.18bfd399531e1981\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-135.ec2.internal.18bfd399531e1981 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-135.ec2.internal,UID:ip-10-0-138-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-135.ec2.internal,},FirstTimestamp:2026-07-06 22:23:52.939944321 +0000 UTC m=+0.363831019,LastTimestamp:2026-07-06 22:23:52.941145446 +0000 UTC m=+0.365032137,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-135.ec2.internal,}" Jul 06 22:23:53.017660 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.017641 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:23:53.022944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.018753 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:23:53.022944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.018784 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:23:53.022944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.018808 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:23:53.022944 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.018835 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:23:53.022944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.021315 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:53.080556 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.080538 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.081223 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.081210 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.081285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.081238 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.081285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.081252 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.081285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.081271 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.087993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.087979 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.088040 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.087999 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-135.ec2.internal\": node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.114173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.114127 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.119206 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.119191 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal"] Jul 06 22:23:53.119259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.119253 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.120379 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.120366 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.120444 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.120389 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.120444 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.120398 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.121367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.121355 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.121472 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.121457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.121550 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.121490 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.122042 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122028 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.122130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122046 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.122130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122071 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.122130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122084 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.122130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122052 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.122308 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.122133 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.123273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.123350 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123289 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:53.123453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.123530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.123530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6793de04b12ec0ed6561fe050df193a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-135.ec2.internal\" (UID: \"b6793de04b12ec0ed6561fe050df193a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.123919 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123904 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:53.123991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123929 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:53.123991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.123938 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:53.152248 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.152226 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-135.ec2.internal\" not found" node="ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.156606 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.156591 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-135.ec2.internal\" not found" node="ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.215005 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.214975 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.223856 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6793de04b12ec0ed6561fe050df193a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-135.ec2.internal\" (UID: \"b6793de04b12ec0ed6561fe050df193a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.223939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.223939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.223939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223920 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.223939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223924 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1354b9a0b0faccfa637858ddc959e5fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal\" (UID: \"1354b9a0b0faccfa637858ddc959e5fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.224090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.223922 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6793de04b12ec0ed6561fe050df193a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-135.ec2.internal\" (UID: \"b6793de04b12ec0ed6561fe050df193a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.319749 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.319725 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.420958 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.420906 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.455038 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.455011 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.460178 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.460166 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:53.521603 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.521579 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.621915 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.621888 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.729520 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.729472 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.830487 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.830465 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.866953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.866916 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:23:53.867384 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.867105 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 22:23:53.890449 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.890420 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:53.930582 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:53.930555 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:53.933064 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.933048 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:53.981812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.981761 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:18:53 +0000 UTC" deadline="2028-02-24 16:32:47.138653753 +0000 UTC" Jul 06 22:23:53.981812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:53.981785 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14346h8m53.156871201s" Jul 06 22:23:54.031082 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:54.031062 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-135.ec2.internal\" not found" Jul 06 22:23:54.073579 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.073555 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:23:54.075236 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.075218 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:23:54.075333 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.075254 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:23:54.075333 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.075267 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:23:54.117444 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:54.117420 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1354b9a0b0faccfa637858ddc959e5fe.slice/crio-247ff10b87f504e9c41b34130d6c53cd952bcf01555f010e07b5e3e76e8510e3 WatchSource:0}: Error finding container 247ff10b87f504e9c41b34130d6c53cd952bcf01555f010e07b5e3e76e8510e3: Status 404 returned error can't find the container with id 247ff10b87f504e9c41b34130d6c53cd952bcf01555f010e07b5e3e76e8510e3 Jul 06 22:23:54.118639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.118614 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:54.122524 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.122504 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" Jul 06 22:23:54.123268 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.123255 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:23:54.131416 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.131391 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:23:54.132306 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.132291 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" Jul 06 22:23:54.144501 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.144483 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:23:54.159925 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:54.159903 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6793de04b12ec0ed6561fe050df193a.slice/crio-060e35a9cd7e6404775f575a1df9e15fc727eae830c6ff185abae1d5161666be WatchSource:0}: Error finding container 060e35a9cd7e6404775f575a1df9e15fc727eae830c6ff185abae1d5161666be: Status 404 returned error can't find the container with id 060e35a9cd7e6404775f575a1df9e15fc727eae830c6ff185abae1d5161666be Jul 06 22:23:54.774850 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.774820 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:23:54.902273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.902244 2568 apiserver.go:52] "Watching apiserver" Jul 06 22:23:54.909640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.909618 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:23:54.911062 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.911033 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz","openshift-cluster-node-tuning-operator/tuned-lxtws","openshift-image-registry/node-ca-pnl72","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal","openshift-multus/multus-additional-cni-plugins-bp7p4","openshift-multus/multus-zlgxb","kube-system/global-pull-secret-syncer-26bcb","openshift-dns/node-resolver-5djdn","openshift-multus/network-metrics-daemon-vs77c","openshift-network-diagnostics/network-check-target-7dvvr","openshift-network-operator/iptables-alerter-4p96h","openshift-ovn-kubernetes/ovnkube-node-2kbgh","kube-system/konnectivity-agent-d2b4j","kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal"] Jul 06 22:23:54.912776 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.912756 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:54.912886 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:54.912855 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:23:54.914183 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.914165 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:54.917660 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.917637 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:23:54.917905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.917882 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4dsk6\"" Jul 06 22:23:54.918211 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.918185 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:23:54.918885 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.918863 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:54.920277 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.920257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:54.921731 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.921709 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-npsdl\"" Jul 06 22:23:54.921986 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.921967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.922706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922524 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:23:54.922706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922593 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:23:54.922706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922620 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.922706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922658 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.922992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922905 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.922992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.922911 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7dj6s\"" Jul 06 22:23:54.923159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.923140 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.923713 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.923502 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.924451 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.924429 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.924896 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925039 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925289 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p7z6f\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925440 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:54.925682 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:54.925510 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:23:54.926508 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.925986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:23:54.926508 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.926421 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f54vl\"" Jul 06 22:23:54.926673 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.926655 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:54.926771 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:54.926753 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:23:54.927986 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.927668 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:54.929868 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.929318 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:54.930480 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.930250 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.930480 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.930262 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.930480 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.930250 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j9st7\"" Jul 06 22:23:54.930698 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.930591 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:54.932277 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.932256 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:54.934845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.933711 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbkd6\"" Jul 06 22:23:54.934964 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.934859 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rrq5j\"" Jul 06 22:23:54.934964 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.934943 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:23:54.935784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935243 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.935784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935421 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:23:54.935784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935578 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.935784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935682 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:23:54.935784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935709 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.936079 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.935979 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:23:54.936139 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.936075 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.936192 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.936158 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rx4cr\"" Jul 06 22:23:54.936244 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.936231 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:23:54.936975 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.936485 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:23:54.936975 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.936867 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:23:54.937419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17ebd9ea-8a86-4dc5-a82c-237926a9f259-agent-certs\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:54.937419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937256 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-netns\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.937419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937307 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:54.937419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-os-release\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.937419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.937710 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937395 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.937710 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.937564 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:23:54.938382 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.938464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-system-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-cnibin\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.938574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-bin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-hostroot\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmcvq\" (UniqueName: \"kubernetes.io/projected/393e5b62-6995-4943-8506-df15f09c3afc-kube-api-access-wmcvq\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938587 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcl52\" (UniqueName: \"kubernetes.io/projected/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-kube-api-access-fcl52\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:54.938724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938619 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/809634c9-67e6-45fd-abb6-4908b9f11684-hosts-file\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:54.938724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-cni-binary-copy\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-conf-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.938960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-host\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:54.938960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhl2\" (UniqueName: \"kubernetes.io/projected/809634c9-67e6-45fd-abb6-4908b9f11684-kube-api-access-jmhl2\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:54.939071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.938967 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.939071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939002 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-socket-dir-parent\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-multus-daemon-config\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-system-cni-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.939270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939089 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk9r4\" (UniqueName: \"kubernetes.io/projected/97b6b946-f277-42dd-a372-ad3704a29af1-kube-api-access-gk9r4\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:54.939270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939120 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-cnibin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-os-release\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-multus\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-etc-kubernetes\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17ebd9ea-8a86-4dc5-a82c-237926a9f259-konnectivity-ca\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-k8s-cni-cncf-io\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-multus-certs\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-serviceca\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:54.939478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809634c9-67e6-45fd-abb6-4908b9f11684-tmp-dir\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:54.939836 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.939503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-kubelet\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:54.940335 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.940313 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:23:54.962336 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.962314 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-klrzw" Jul 06 22:23:54.968808 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:54.968776 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-klrzw" Jul 06 22:23:55.024269 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.024250 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:23:55.025507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.025433 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" event={"ID":"b6793de04b12ec0ed6561fe050df193a","Type":"ContainerStarted","Data":"060e35a9cd7e6404775f575a1df9e15fc727eae830c6ff185abae1d5161666be"} Jul 06 22:23:55.026993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.026965 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" event={"ID":"1354b9a0b0faccfa637858ddc959e5fe","Type":"ContainerStarted","Data":"247ff10b87f504e9c41b34130d6c53cd952bcf01555f010e07b5e3e76e8510e3"} Jul 06 22:23:55.040266 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.040370 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.040370 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-systemd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.040370 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-var-lib-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.040370 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-env-overrides\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/809634c9-67e6-45fd-abb6-4908b9f11684-hosts-file\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-systemd\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-host\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-multus-daemon-config\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/809634c9-67e6-45fd-abb6-4908b9f11684-hosts-file\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.040598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovn-node-metrics-cert\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysconfig\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040641 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-host\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-host\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-system-cni-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-os-release\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-etc-kubernetes\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17ebd9ea-8a86-4dc5-a82c-237926a9f259-konnectivity-ca\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-k8s-cni-cncf-io\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-multus-certs\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-etc-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.040949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-serviceca\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809634c9-67e6-45fd-abb6-4908b9f11684-tmp-dir\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-kubelet\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.041146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-ovn\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-netd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-modprobe-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-kubernetes\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17ebd9ea-8a86-4dc5-a82c-237926a9f259-agent-certs\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041278 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-conf\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-sys\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8klg\" (UniqueName: \"kubernetes.io/projected/46921a19-48e8-471c-9891-a59b863316e6-kube-api-access-n8klg\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041416 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-system-cni-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-os-release\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041471 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041477 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-os-release\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041498 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-multus-daemon-config\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042074 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041524 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-etc-kubernetes\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041564 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-k8s-cni-cncf-io\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-system-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041600 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmcvq\" (UniqueName: \"kubernetes.io/projected/393e5b62-6995-4943-8506-df15f09c3afc-kube-api-access-wmcvq\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041613 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-multus-certs\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-kubelet\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-cnibin\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-bin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-hostroot\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-log-socket\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041784 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-config\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk42m\" (UniqueName: \"kubernetes.io/projected/faae7ecf-74a2-498b-ab1e-19ee191efd3a-kube-api-access-wk42m\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-var-lib-kubelet\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041873 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-tuned\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.042960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.041907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcl52\" (UniqueName: \"kubernetes.io/projected/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-kube-api-access-fcl52\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042090 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17ebd9ea-8a86-4dc5-a82c-237926a9f259-konnectivity-ca\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042105 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/809634c9-67e6-45fd-abb6-4908b9f11684-tmp-dir\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-serviceca\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-kubelet\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042224 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-cnibin\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042263 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-bin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b6b946-f277-42dd-a372-ad3704a29af1-os-release\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042303 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-system-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-hostroot\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-cni-binary-copy\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042395 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042449 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-conf-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-slash\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-conf-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-dbus\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042614 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-tmp\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.043826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhl2\" (UniqueName: \"kubernetes.io/projected/809634c9-67e6-45fd-abb6-4908b9f11684-kube-api-access-jmhl2\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-socket-dir-parent\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042871 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b6b946-f277-42dd-a372-ad3704a29af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46921a19-48e8-471c-9891-a59b863316e6-host-slash\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042901 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-socket-dir-parent\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk9r4\" (UniqueName: \"kubernetes.io/projected/97b6b946-f277-42dd-a372-ad3704a29af1-kube-api-access-gk9r4\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/393e5b62-6995-4943-8506-df15f09c3afc-cni-binary-copy\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.042971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-cnibin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-multus\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043072 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwsp\" (UniqueName: \"kubernetes.io/projected/13808416-159f-475e-bfa8-00f2b0094637-kube-api-access-9jwsp\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043088 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-multus-cni-dir\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-device-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-cnibin\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-netns\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043134 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-var-lib-cni-multus\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.044740 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-node-log\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043221 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-run\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b48sw\" (UniqueName: \"kubernetes.io/projected/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-kube-api-access-b48sw\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46921a19-48e8-471c-9891-a59b863316e6-iptables-alerter-script\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-systemd-units\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-bin\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-kubelet-config\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-netns\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mgbg\" (UniqueName: \"kubernetes.io/projected/ff98bb46-2243-4037-a1c7-ebecef310dd4-kube-api-access-9mgbg\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-script-lib\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-lib-modules\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.045649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.043570 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/393e5b62-6995-4943-8506-df15f09c3afc-host-run-netns\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.047831 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.047751 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17ebd9ea-8a86-4dc5-a82c-237926a9f259-agent-certs\") pod \"konnectivity-agent-d2b4j\" (UID: \"17ebd9ea-8a86-4dc5-a82c-237926a9f259\") " pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:55.049166 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.049140 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:55.049166 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.049161 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:55.049346 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.049175 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.049346 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.049304 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.549241903 +0000 UTC m=+2.973128883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.053182 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.053132 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcl52\" (UniqueName: \"kubernetes.io/projected/b42a6238-f202-4ebe-8abe-379c0c2c9bfc-kube-api-access-fcl52\") pod \"node-ca-pnl72\" (UID: \"b42a6238-f202-4ebe-8abe-379c0c2c9bfc\") " pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.054080 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.054030 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhl2\" (UniqueName: \"kubernetes.io/projected/809634c9-67e6-45fd-abb6-4908b9f11684-kube-api-access-jmhl2\") pod \"node-resolver-5djdn\" (UID: \"809634c9-67e6-45fd-abb6-4908b9f11684\") " pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.056201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.056142 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk9r4\" (UniqueName: \"kubernetes.io/projected/97b6b946-f277-42dd-a372-ad3704a29af1-kube-api-access-gk9r4\") pod \"multus-additional-cni-plugins-bp7p4\" (UID: \"97b6b946-f277-42dd-a372-ad3704a29af1\") " pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.056767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.056727 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmcvq\" (UniqueName: \"kubernetes.io/projected/393e5b62-6995-4943-8506-df15f09c3afc-kube-api-access-wmcvq\") pod \"multus-zlgxb\" (UID: \"393e5b62-6995-4943-8506-df15f09c3afc\") " pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.144295 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-systemd-units\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-systemd-units\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-bin\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-kubelet-config\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144384 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-bin\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mgbg\" (UniqueName: \"kubernetes.io/projected/ff98bb46-2243-4037-a1c7-ebecef310dd4-kube-api-access-9mgbg\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-script-lib\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-lib-modules\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-kubelet-config\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144573 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-systemd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144602 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-var-lib-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-env-overrides\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-systemd\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144754 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovn-node-metrics-cert\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysconfig\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-host\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-etc-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.144927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-ovn\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-netd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-modprobe-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.144991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-kubernetes\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-conf\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-sys\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8klg\" (UniqueName: \"kubernetes.io/projected/46921a19-48e8-471c-9891-a59b863316e6-kube-api-access-n8klg\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145165 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-kubelet\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-log-socket\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145251 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-config\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk42m\" (UniqueName: \"kubernetes.io/projected/faae7ecf-74a2-498b-ab1e-19ee191efd3a-kube-api-access-wk42m\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-var-lib-kubelet\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-tuned\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-slash\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.145748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-script-lib\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145375 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-ovn\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-run-systemd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145391 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-dbus\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-cni-netd\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0668c2b5-b49e-4f1c-96e2-48abe887370b-dbus\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-tmp\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.145485 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46921a19-48e8-471c-9891-a59b863316e6-host-slash\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145529 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwsp\" (UniqueName: \"kubernetes.io/projected/13808416-159f-475e-bfa8-00f2b0094637-kube-api-access-9jwsp\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.145551 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.645532285 +0000 UTC m=+3.069418980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-lib-modules\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-device-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-netns\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145633 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-device-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-netns\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.146675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-node-log\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-run\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145752 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145757 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-modprobe-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b48sw\" (UniqueName: \"kubernetes.io/projected/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-kube-api-access-b48sw\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46921a19-48e8-471c-9891-a59b863316e6-iptables-alerter-script\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-kubernetes\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-sys\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-conf\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-var-lib-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146100 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysconfig\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146147 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-host\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-node-log\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.145387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-slash\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.147536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-log-socket\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-var-lib-kubelet\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146401 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-env-overrides\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-run\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-sysctl-d\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146550 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46921a19-48e8-471c-9891-a59b863316e6-host-slash\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146611 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff98bb46-2243-4037-a1c7-ebecef310dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146656 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-systemd\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146726 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovnkube-config\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.146982 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/46921a19-48e8-471c-9891-a59b863316e6-iptables-alerter-script\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.147031 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.147039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.147077 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-host-kubelet\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.147085 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:55.647068188 +0000 UTC m=+3.070954869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.148534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.147233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faae7ecf-74a2-498b-ab1e-19ee191efd3a-etc-openvswitch\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.149367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.149338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-etc-tuned\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.149746 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.149706 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-tmp\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.150035 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.150011 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faae7ecf-74a2-498b-ab1e-19ee191efd3a-ovn-node-metrics-cert\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.156237 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.156209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mgbg\" (UniqueName: \"kubernetes.io/projected/ff98bb46-2243-4037-a1c7-ebecef310dd4-kube-api-access-9mgbg\") pod \"aws-ebs-csi-driver-node-jwrjz\" (UID: \"ff98bb46-2243-4037-a1c7-ebecef310dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.158075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.158029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwsp\" (UniqueName: \"kubernetes.io/projected/13808416-159f-475e-bfa8-00f2b0094637-kube-api-access-9jwsp\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.159088 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.159064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8klg\" (UniqueName: \"kubernetes.io/projected/46921a19-48e8-471c-9891-a59b863316e6-kube-api-access-n8klg\") pod \"iptables-alerter-4p96h\" (UID: \"46921a19-48e8-471c-9891-a59b863316e6\") " pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.159201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.159067 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk42m\" (UniqueName: \"kubernetes.io/projected/faae7ecf-74a2-498b-ab1e-19ee191efd3a-kube-api-access-wk42m\") pod \"ovnkube-node-2kbgh\" (UID: \"faae7ecf-74a2-498b-ab1e-19ee191efd3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.159555 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.159536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b48sw\" (UniqueName: \"kubernetes.io/projected/6485ca6f-ffc0-4a8a-8628-28156abc2dd8-kube-api-access-b48sw\") pod \"tuned-lxtws\" (UID: \"6485ca6f-ffc0-4a8a-8628-28156abc2dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.229358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.229322 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:23:55.241462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.241441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pnl72" Jul 06 22:23:55.241675 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:55.241651 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ebd9ea_8a86_4dc5_a82c_237926a9f259.slice/crio-c00a7c51338836ec2371cee5034c1401a262e8c3bc4f4b87ea90da7c3c9bb9f7 WatchSource:0}: Error finding container c00a7c51338836ec2371cee5034c1401a262e8c3bc4f4b87ea90da7c3c9bb9f7: Status 404 returned error can't find the container with id c00a7c51338836ec2371cee5034c1401a262e8c3bc4f4b87ea90da7c3c9bb9f7 Jul 06 22:23:55.249971 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:55.249946 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42a6238_f202_4ebe_8abe_379c0c2c9bfc.slice/crio-9885a9472a55551b086c7ee1f3b2398c5483d50b405c18e643265cbe4c775710 WatchSource:0}: Error finding container 9885a9472a55551b086c7ee1f3b2398c5483d50b405c18e643265cbe4c775710: Status 404 returned error can't find the container with id 9885a9472a55551b086c7ee1f3b2398c5483d50b405c18e643265cbe4c775710 Jul 06 22:23:55.253421 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.253403 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5djdn" Jul 06 22:23:55.261544 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.261521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" Jul 06 22:23:55.261804 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:55.261780 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809634c9_67e6_45fd_abb6_4908b9f11684.slice/crio-c631380ac659e560ec6d9675885b93c062a86d57aa9782e50bb72e6ba3d9838a WatchSource:0}: Error finding container c631380ac659e560ec6d9675885b93c062a86d57aa9782e50bb72e6ba3d9838a: Status 404 returned error can't find the container with id c631380ac659e560ec6d9675885b93c062a86d57aa9782e50bb72e6ba3d9838a Jul 06 22:23:55.269587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.269558 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlgxb" Jul 06 22:23:55.269846 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:55.269826 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b6b946_f277_42dd_a372_ad3704a29af1.slice/crio-60d56647a62cd277cf22df3148c251b1e83f1f4905ed1eae5397f0fff04cabec WatchSource:0}: Error finding container 60d56647a62cd277cf22df3148c251b1e83f1f4905ed1eae5397f0fff04cabec: Status 404 returned error can't find the container with id 60d56647a62cd277cf22df3148c251b1e83f1f4905ed1eae5397f0fff04cabec Jul 06 22:23:55.277485 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:55.277439 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393e5b62_6995_4943_8506_df15f09c3afc.slice/crio-84e4c8848ec5bb47a0545a6a54ea4c6b646abeb7938e3f0dc329a8c90c635126 WatchSource:0}: Error finding container 84e4c8848ec5bb47a0545a6a54ea4c6b646abeb7938e3f0dc329a8c90c635126: Status 404 returned error can't find the container with id 84e4c8848ec5bb47a0545a6a54ea4c6b646abeb7938e3f0dc329a8c90c635126 Jul 06 22:23:55.278168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.278145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lxtws" Jul 06 22:23:55.288956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.288938 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" Jul 06 22:23:55.296592 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.296569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p96h" Jul 06 22:23:55.311380 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.311355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:23:55.649949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.649870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:55.649949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.649911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.649965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650029 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650072 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650088 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650114 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650096 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.65007962 +0000 UTC m=+4.073966321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650125 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650142 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.650125727 +0000 UTC m=+4.074012406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:55.650173 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:55.650165 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:56.650152892 +0000 UTC m=+4.074039575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:55.972259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.972169 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:18:55 +0000 UTC" deadline="2028-04-03 17:39:38.34174519 +0000 UTC" Jul 06 22:23:55.972259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:55.972212 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15283h15m42.369540915s" Jul 06 22:23:56.030419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.030385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlgxb" event={"ID":"393e5b62-6995-4943-8506-df15f09c3afc","Type":"ContainerStarted","Data":"84e4c8848ec5bb47a0545a6a54ea4c6b646abeb7938e3f0dc329a8c90c635126"} Jul 06 22:23:56.031612 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.031584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerStarted","Data":"60d56647a62cd277cf22df3148c251b1e83f1f4905ed1eae5397f0fff04cabec"} Jul 06 22:23:56.032823 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.032787 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5djdn" event={"ID":"809634c9-67e6-45fd-abb6-4908b9f11684","Type":"ContainerStarted","Data":"c631380ac659e560ec6d9675885b93c062a86d57aa9782e50bb72e6ba3d9838a"} Jul 06 22:23:56.034025 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.034001 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pnl72" event={"ID":"b42a6238-f202-4ebe-8abe-379c0c2c9bfc","Type":"ContainerStarted","Data":"9885a9472a55551b086c7ee1f3b2398c5483d50b405c18e643265cbe4c775710"} Jul 06 22:23:56.035171 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.035145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2b4j" event={"ID":"17ebd9ea-8a86-4dc5-a82c-237926a9f259","Type":"ContainerStarted","Data":"c00a7c51338836ec2371cee5034c1401a262e8c3bc4f4b87ea90da7c3c9bb9f7"} Jul 06 22:23:56.328119 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:56.328044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46921a19_48e8_471c_9891_a59b863316e6.slice/crio-62b73415aa5fcda23d45e5d422c7602822e7724f1e85b59494874a2d0d830c46 WatchSource:0}: Error finding container 62b73415aa5fcda23d45e5d422c7602822e7724f1e85b59494874a2d0d830c46: Status 404 returned error can't find the container with id 62b73415aa5fcda23d45e5d422c7602822e7724f1e85b59494874a2d0d830c46 Jul 06 22:23:56.329243 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:56.329215 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaae7ecf_74a2_498b_ab1e_19ee191efd3a.slice/crio-c2415343d096be83b65f46fdedf46c85aea75c2537f6f8f8b4dc84126d5aba53 WatchSource:0}: Error finding container c2415343d096be83b65f46fdedf46c85aea75c2537f6f8f8b4dc84126d5aba53: Status 404 returned error can't find the container with id c2415343d096be83b65f46fdedf46c85aea75c2537f6f8f8b4dc84126d5aba53 Jul 06 22:23:56.330655 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:56.330626 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff98bb46_2243_4037_a1c7_ebecef310dd4.slice/crio-f5abaad6c86ea42a8e641357c7ee0d2cbf88e8d726b91936e5abeed3234018fa WatchSource:0}: Error finding container f5abaad6c86ea42a8e641357c7ee0d2cbf88e8d726b91936e5abeed3234018fa: Status 404 returned error can't find the container with id f5abaad6c86ea42a8e641357c7ee0d2cbf88e8d726b91936e5abeed3234018fa Jul 06 22:23:56.331633 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:23:56.331608 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6485ca6f_ffc0_4a8a_8628_28156abc2dd8.slice/crio-c7ba24276b6b2ded5646aa085f8932effa9cf12a816a659b83b5f979e61c12a2 WatchSource:0}: Error finding container c7ba24276b6b2ded5646aa085f8932effa9cf12a816a659b83b5f979e61c12a2: Status 404 returned error can't find the container with id c7ba24276b6b2ded5646aa085f8932effa9cf12a816a659b83b5f979e61c12a2 Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.656986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.657297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.657338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657537 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657556 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657569 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657627 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.657607886 +0000 UTC m=+6.081494575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657910 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.657966 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.657950351 +0000 UTC m=+6.081837048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:56.658073 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.658031 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:56.658732 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:56.658087 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:23:58.658054892 +0000 UTC m=+6.081941572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:56.972894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.972751 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:18:55 +0000 UTC" deadline="2028-01-29 07:18:51.378403891 +0000 UTC" Jul 06 22:23:56.972894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:56.972814 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13712h54m54.405594298s" Jul 06 22:23:57.021428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.020923 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:57.021428 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:57.021049 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:23:57.022110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.021819 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:57.022110 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:57.021935 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:23:57.022110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.022008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:57.022110 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:57.022082 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:23:57.047502 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.047473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" event={"ID":"b6793de04b12ec0ed6561fe050df193a","Type":"ContainerStarted","Data":"78d7692ae6d33afd0c741ac6f68a5ce1b9a8ce7959f3fa26f5210ac1d75687d1"} Jul 06 22:23:57.073317 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.073287 2568 generic.go:356] "Generic (PLEG): container finished" podID="1354b9a0b0faccfa637858ddc959e5fe" containerID="6ac2c009db44e01d52b32e175ba7563b513162a250f8d6f561b21448894b4493" exitCode=0 Jul 06 22:23:57.073916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.073889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" event={"ID":"1354b9a0b0faccfa637858ddc959e5fe","Type":"ContainerDied","Data":"6ac2c009db44e01d52b32e175ba7563b513162a250f8d6f561b21448894b4493"} Jul 06 22:23:57.082316 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.082283 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxtws" event={"ID":"6485ca6f-ffc0-4a8a-8628-28156abc2dd8","Type":"ContainerStarted","Data":"c7ba24276b6b2ded5646aa085f8932effa9cf12a816a659b83b5f979e61c12a2"} Jul 06 22:23:57.092699 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.092389 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-135.ec2.internal" podStartSLOduration=2.092371288 podStartE2EDuration="2.092371288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:23:57.065036635 +0000 UTC m=+4.488923337" watchObservedRunningTime="2026-07-06 22:23:57.092371288 +0000 UTC m=+4.516257993" Jul 06 22:23:57.101637 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.101542 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" event={"ID":"ff98bb46-2243-4037-a1c7-ebecef310dd4","Type":"ContainerStarted","Data":"f5abaad6c86ea42a8e641357c7ee0d2cbf88e8d726b91936e5abeed3234018fa"} Jul 06 22:23:57.109239 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.109210 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"c2415343d096be83b65f46fdedf46c85aea75c2537f6f8f8b4dc84126d5aba53"} Jul 06 22:23:57.114639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:57.114592 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p96h" event={"ID":"46921a19-48e8-471c-9891-a59b863316e6","Type":"ContainerStarted","Data":"62b73415aa5fcda23d45e5d422c7602822e7724f1e85b59494874a2d0d830c46"} Jul 06 22:23:58.135930 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:58.135740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" event={"ID":"1354b9a0b0faccfa637858ddc959e5fe","Type":"ContainerStarted","Data":"03f127fa29f7c13f6ad793fffa2979f19369dd21ac6c38bb5ca06df701995c7d"} Jul 06 22:23:58.671992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:58.671953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:58.672188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:58.672027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:58.672188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:58.672060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:58.672373 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672242 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:23:58.672373 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672266 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:23:58.672373 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672279 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:58.672373 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672340 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.672320151 +0000 UTC m=+10.096206847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:23:58.672764 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672742 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:58.672882 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672817 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.672800426 +0000 UTC m=+10.096687122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:23:58.672951 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672882 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:58.672951 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:58.672913 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:02.67290305 +0000 UTC m=+10.096789738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:23:59.030949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:59.030913 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:23:59.031168 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:59.031104 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:23:59.031621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:59.031600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:23:59.031751 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:59.031731 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:23:59.031847 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:23:59.031839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:23:59.031999 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:23:59.031972 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:01.020104 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:01.020113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:01.020253 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:01.020350 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:01.020407 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:01.021832 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:01.020500 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:02.709694 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:02.709525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:02.709694 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:02.709589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:02.709694 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:02.709622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709762 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709767 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709825 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.709806201 +0000 UTC m=+18.133692897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709845 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.709834354 +0000 UTC m=+18.133721040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709900 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709921 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709933 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:02.710290 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:02.709977 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:10.709960047 +0000 UTC m=+18.133846730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:03.020691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:03.020631 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:03.020879 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:03.020743 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:03.021250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:03.020993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:03.021250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:03.021107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:03.021250 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:03.021125 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:03.021250 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:03.021211 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:05.019892 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:05.019848 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:05.019892 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:05.019868 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:05.020455 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:05.019986 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:05.020455 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:05.020038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:05.020455 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:05.020179 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:05.020455 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:05.020267 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:07.020802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:07.020770 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:07.020802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:07.020792 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:07.021258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:07.020776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:07.021258 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:07.020897 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:07.021258 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:07.020979 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:07.021258 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:07.021079 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:09.019768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:09.019734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:09.020201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:09.019770 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:09.020201 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:09.019859 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:09.020201 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:09.019919 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:09.020201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:09.019967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:09.020201 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:09.020046 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:10.774471 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:10.774435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:10.774471 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:10.774467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774564 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:10.774583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774571 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774643 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774648 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774656 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774619 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.774600906 +0000 UTC m=+34.198487584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774722 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.774693504 +0000 UTC m=+34.198580199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:10.775041 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:10.774744 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:26.774735103 +0000 UTC m=+34.198621786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:11.023218 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:11.023188 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:11.023394 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:11.023302 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:11.023394 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:11.023307 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:11.023503 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:11.023418 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:11.023503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:11.023306 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:11.023579 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:11.023523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:13.021984 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:13.021948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:13.022387 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:13.022061 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:13.022387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:13.022073 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:13.022387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:13.022081 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:13.022387 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:13.022195 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:13.022387 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:13.022237 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:15.028183 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.027876 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:15.028183 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:15.027988 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:15.029312 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.028901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:15.029312 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:15.028995 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:15.029312 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.029054 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:15.029312 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:15.029131 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:15.173524 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.173234 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlgxb" event={"ID":"393e5b62-6995-4943-8506-df15f09c3afc","Type":"ContainerStarted","Data":"1975f72e5392907fc2912b25caeebbba92de2c1c28913eb84906563500d4ccfb"} Jul 06 22:24:15.175452 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.175427 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerStarted","Data":"005142e90361223386bb95dbea0dfcbd5d520345864e00864105d538b1e7fd23"} Jul 06 22:24:15.177541 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.177518 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5djdn" event={"ID":"809634c9-67e6-45fd-abb6-4908b9f11684","Type":"ContainerStarted","Data":"0377d03ecb82b7d3890cbd9475971d0e802cc004fe1e2aeac15c8a00c6a35d82"} Jul 06 22:24:15.179045 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.179019 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pnl72" event={"ID":"b42a6238-f202-4ebe-8abe-379c0c2c9bfc","Type":"ContainerStarted","Data":"bff6b32f32834475156dcbe070c603ea77f0a2036110bbc283e17696c7a08f57"} Jul 06 22:24:15.181216 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.180884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2b4j" event={"ID":"17ebd9ea-8a86-4dc5-a82c-237926a9f259","Type":"ContainerStarted","Data":"2aa78a769b57a5e6f23c81309455b60054d4165d1d819e32bf5d786d2f706b84"} Jul 06 22:24:15.182831 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.182565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lxtws" event={"ID":"6485ca6f-ffc0-4a8a-8628-28156abc2dd8","Type":"ContainerStarted","Data":"5985db3c516117a2b723fe6b158fd85e0f8109c56c0ca9c40cfe05a6bf62f958"} Jul 06 22:24:15.184172 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.184145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" event={"ID":"ff98bb46-2243-4037-a1c7-ebecef310dd4","Type":"ContainerStarted","Data":"1eac0de1c320c7fe6108c91c4efcf3f43431768fe23d319ef757fb0f3ab7b06d"} Jul 06 22:24:15.186196 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.186105 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"4ad0a7394a67188532f9447191decf2f8fbfd633d790ba86cd7a113e8a669850"} Jul 06 22:24:15.186196 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.186156 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"53f97673c13f19e969e38b216e6d4c7f46642023dff109bff1fae7b5c1034ed4"} Jul 06 22:24:15.200115 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.200077 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-135.ec2.internal" podStartSLOduration=20.200064855 podStartE2EDuration="20.200064855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:23:58.152538941 +0000 UTC m=+5.576425645" watchObservedRunningTime="2026-07-06 22:24:15.200064855 +0000 UTC m=+22.623951557" Jul 06 22:24:15.214956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.214915 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d2b4j" podStartSLOduration=5.885853125 podStartE2EDuration="21.21490136s" totalImagesPullingTime="15.329048235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.214652698 +0000 UTC m=+22.638539398" watchObservedRunningTime="2026-07-06 22:24:15.21490136 +0000 UTC m=+22.638788060" Jul 06 22:24:15.229989 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.229948 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pnl72" podStartSLOduration=1.5750328 podStartE2EDuration="21.229934903s" totalImagesPullingTime="19.654902103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.229613012 +0000 UTC m=+22.653499712" watchObservedRunningTime="2026-07-06 22:24:15.229934903 +0000 UTC m=+22.653821602" Jul 06 22:24:15.248517 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.248470 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zlgxb" podStartSLOduration=1.5670849580000001 podStartE2EDuration="21.248455876s" totalImagesPullingTime="19.681370918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.247948255 +0000 UTC m=+22.671834954" watchObservedRunningTime="2026-07-06 22:24:15.248455876 +0000 UTC m=+22.672342577" Jul 06 22:24:15.275680 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.275629 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lxtws" podStartSLOduration=2.700932205 podStartE2EDuration="21.275609164s" totalImagesPullingTime="18.574676959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.269008944 +0000 UTC m=+22.692895645" watchObservedRunningTime="2026-07-06 22:24:15.275609164 +0000 UTC m=+22.699495865" Jul 06 22:24:15.287701 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:15.287664 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5djdn" podStartSLOduration=1.644460883 podStartE2EDuration="21.287648073s" totalImagesPullingTime="19.64318719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:15.287246461 +0000 UTC m=+22.711133160" watchObservedRunningTime="2026-07-06 22:24:15.287648073 +0000 UTC m=+22.711534772" Jul 06 22:24:16.192343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.192266 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"6542795e8dadbc40bd99a4e20130a82224e6fb5c59cb7bec2716b6b4da98f0bc"} Jul 06 22:24:16.193146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.192382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"6fbe77674633f0dba38bd294598edd21be2b51f6bf7dfd24bb5a41e35f41bf46"} Jul 06 22:24:16.193146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.192426 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"c0226a0cd1a4648f4f0bf0d406c7e28a29e1d07bd69128871837a3c2bc0c4687"} Jul 06 22:24:16.193146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.192467 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"bb90a509620150092872cd2ab602359a82f400703f6e14a494e82786e43ef155"} Jul 06 22:24:16.193987 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.193957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p96h" event={"ID":"46921a19-48e8-471c-9891-a59b863316e6","Type":"ContainerStarted","Data":"39e4469765ebe7d8b62fe6fc21ddd0133400c99373b8b7c858b4eabbdeba8a64"} Jul 06 22:24:16.195437 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.195416 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="005142e90361223386bb95dbea0dfcbd5d520345864e00864105d538b1e7fd23" exitCode=0 Jul 06 22:24:16.195539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.195511 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"005142e90361223386bb95dbea0dfcbd5d520345864e00864105d538b1e7fd23"} Jul 06 22:24:16.208664 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.208622 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4p96h" podStartSLOduration=7.965675583 podStartE2EDuration="22.208609395s" totalImagesPullingTime="14.242933812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:16.208397861 +0000 UTC m=+23.632284561" watchObservedRunningTime="2026-07-06 22:24:16.208609395 +0000 UTC m=+23.632496095" Jul 06 22:24:16.899297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.899269 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:24:16.991468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.991362 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:24:16.899293649Z","UUID":"2f9a07dc-077b-4f25-a9ed-867a9d855b5d","Handler":null,"Name":"","Endpoint":""} Jul 06 22:24:16.992585 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.992570 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:24:16.992674 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:16.992603 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:24:17.019785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:17.019652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:17.019899 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:17.019652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:17.019899 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:17.019830 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:17.020019 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:17.019910 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:17.020019 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:17.019795 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:17.020019 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:17.020001 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:17.200294 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:17.200265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" event={"ID":"ff98bb46-2243-4037-a1c7-ebecef310dd4","Type":"ContainerStarted","Data":"4f8d7047842d9f0a5624641e6792370b95f5ae95193211d768c7ef79813ac4a2"} Jul 06 22:24:18.064852 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.064828 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:24:18.065359 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.065339 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:24:18.204007 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.203972 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" event={"ID":"ff98bb46-2243-4037-a1c7-ebecef310dd4","Type":"ContainerStarted","Data":"f5aebc08412e61879186211c215fb4a4e65a9355a529b84e207cf44885ed6609"} Jul 06 22:24:18.206805 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.206776 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"0241d0ef2c17a1efddb63ae50f13532bb316aef5e028d800cd310617d08ce60a"} Jul 06 22:24:18.206999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.206981 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:24:18.207380 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.207368 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d2b4j" Jul 06 22:24:18.233388 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:18.233348 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwrjz" podStartSLOduration=2.859203029 podStartE2EDuration="24.233329928s" totalImagesPullingTime="21.374126899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:18.220033247 +0000 UTC m=+25.643919949" watchObservedRunningTime="2026-07-06 22:24:18.233329928 +0000 UTC m=+25.657216628" Jul 06 22:24:19.019419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:19.019234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:19.019587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:19.019234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:19.019587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:19.019319 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:19.019587 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:19.019518 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:19.019587 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:19.019579 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:19.019839 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:19.019658 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:21.020061 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.019868 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:21.020658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.019928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:21.020658 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:21.020154 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:21.020658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.019959 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:21.020658 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:21.020243 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:21.020658 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:21.020329 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:21.214955 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.214873 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="20582e545cac3920fe7eb7bf390faee573e5d88ad839c0ec354893f26a7be572" exitCode=0 Jul 06 22:24:21.215062 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.214960 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"20582e545cac3920fe7eb7bf390faee573e5d88ad839c0ec354893f26a7be572"} Jul 06 22:24:21.219977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.219893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" event={"ID":"faae7ecf-74a2-498b-ab1e-19ee191efd3a","Type":"ContainerStarted","Data":"72d116ea7889905bac8f4f962b40de65bf7f59def1c1dec995653594fa4a3068"} Jul 06 22:24:21.222191 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.222101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:21.222695 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.222672 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:21.222825 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.222765 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:21.237193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.237176 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:21.237281 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.237267 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:21.270875 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:21.270837 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" podStartSLOduration=8.62535776 podStartE2EDuration="27.270824311s" totalImagesPullingTime="18.645466551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:21.268677538 +0000 UTC m=+28.692564237" watchObservedRunningTime="2026-07-06 22:24:21.270824311 +0000 UTC m=+28.694711011" Jul 06 22:24:22.822956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.822930 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26bcb"] Jul 06 22:24:22.823355 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.823038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:22.823355 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:22.823132 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:22.825833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.825808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7dvvr"] Jul 06 22:24:22.825946 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.825895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:22.826030 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:22.825971 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:22.826391 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.826367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vs77c"] Jul 06 22:24:22.826500 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:22.826472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:22.826566 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:22.826553 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:23.225989 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:23.225911 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="6251434d1857616e3d7a3a7749d9798017bf3b234d97c5aecbefa69506bd1974" exitCode=0 Jul 06 22:24:23.226135 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:23.225985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"6251434d1857616e3d7a3a7749d9798017bf3b234d97c5aecbefa69506bd1974"} Jul 06 22:24:25.019483 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:25.019311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:25.019840 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:25.019327 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:25.019840 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:25.019567 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:25.019840 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:25.019329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:25.019840 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:25.019644 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:25.019840 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:25.019754 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:25.232003 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:25.231969 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="7c2d4a821857aaaccc83a5602762e5ac9a1d51cbc2a3b152682ed478175163ba" exitCode=0 Jul 06 22:24:25.232124 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:25.232029 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"7c2d4a821857aaaccc83a5602762e5ac9a1d51cbc2a3b152682ed478175163ba"} Jul 06 22:24:26.798386 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:26.798351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:26.798392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798516 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798582 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret podName:0668c2b5-b49e-4f1c-96e2-48abe887370b nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.798561308 +0000 UTC m=+66.222448008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret") pod "global-pull-secret-syncer-26bcb" (UID: "0668c2b5-b49e-4f1c-96e2-48abe887370b") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798596 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798617 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798629 2568 projected.go:196] Error preparing data for projected volume kube-api-access-vbctz for pod openshift-network-diagnostics/network-check-target-7dvvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798678 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz podName:83adf7f8-ee3f-428e-874c-aa1f6ad76587 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.798660487 +0000 UTC m=+66.222547180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vbctz" (UniqueName: "kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz") pod "network-check-target-7dvvr" (UID: "83adf7f8-ee3f-428e-874c-aa1f6ad76587") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:26.798726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798813 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:26.798854 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:26.798856 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs podName:13808416-159f-475e-bfa8-00f2b0094637 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:58.798843489 +0000 UTC m=+66.222730167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs") pod "network-metrics-daemon-vs77c" (UID: "13808416-159f-475e-bfa8-00f2b0094637") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:24:27.019508 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.019477 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:27.019692 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.019481 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:27.019692 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:27.019583 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-26bcb" podUID="0668c2b5-b49e-4f1c-96e2-48abe887370b" Jul 06 22:24:27.019692 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.019597 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:27.019894 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:27.019695 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vs77c" podUID="13808416-159f-475e-bfa8-00f2b0094637" Jul 06 22:24:27.019894 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:27.019799 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7dvvr" podUID="83adf7f8-ee3f-428e-874c-aa1f6ad76587" Jul 06 22:24:27.879656 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.879627 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-135.ec2.internal" event="NodeReady" Jul 06 22:24:27.880096 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.879792 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:24:27.915536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.915179 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b"] Jul 06 22:24:27.917177 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.917158 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:27.918741 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.918698 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:24:27.919526 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.919504 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 22:24:27.919630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.919616 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 22:24:27.920044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.920025 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.920158 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.920103 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zqfml\"" Jul 06 22:24:27.920158 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.920150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.920472 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.920457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:27.925318 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.925303 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c4gjv\"" Jul 06 22:24:27.925532 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.925512 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:24:27.925621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.925547 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:24:27.926349 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.926190 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:24:27.932763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.932669 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b"] Jul 06 22:24:27.935307 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.935281 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc"] Jul 06 22:24:27.936439 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.936421 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:24:27.937413 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.937385 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b777fbb4c-rnppq"] Jul 06 22:24:27.937535 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.937508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" Jul 06 22:24:27.940383 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.940367 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2"] Jul 06 22:24:27.940550 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.940513 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:27.940993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.940885 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.940993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.940915 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.940993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.940915 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hfh89\"" Jul 06 22:24:27.941973 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.941958 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mktxb"] Jul 06 22:24:27.942098 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.942080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:27.943090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.942944 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nhwxz\"" Jul 06 22:24:27.943090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.942976 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 22:24:27.943090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943022 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.943287 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943215 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 22:24:27.943449 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943430 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.943517 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943447 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-59gps"] Jul 06 22:24:27.943571 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943564 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 22:24:27.943671 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 22:24:27.943879 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.943850 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:27.945291 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.945276 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt"] Jul 06 22:24:27.945401 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.945388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:27.945481 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.945466 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-czmpl\"" Jul 06 22:24:27.945595 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.945577 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 22:24:27.946298 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946266 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.946489 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946468 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.946650 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 22:24:27.946650 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946343 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 22:24:27.946830 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946385 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.946900 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946881 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.946998 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.946980 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2"] Jul 06 22:24:27.947131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.947002 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w8bzm\"" Jul 06 22:24:27.947194 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.947127 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:27.949415 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.949018 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:27.949415 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.949407 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6mxcf\"" Jul 06 22:24:27.949818 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.949802 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 22:24:27.950047 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.950031 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.950284 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.950254 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.950511 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.950494 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 22:24:27.954447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.954422 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:24:27.955841 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.955664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 22:24:27.956558 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.956533 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 22:24:27.956640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.956591 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.956787 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.956771 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 22:24:27.956872 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.956792 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.957820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.957535 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 22:24:27.957820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.957566 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h9cnv\"" Jul 06 22:24:27.957820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.957675 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.957820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.957683 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pvljq\"" Jul 06 22:24:27.957820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.957784 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.964567 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.964550 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc"] Jul 06 22:24:27.966351 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.966329 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 22:24:27.966724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.966691 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2"] Jul 06 22:24:27.968457 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.968439 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mktxb"] Jul 06 22:24:27.971413 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.971398 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b777fbb4c-rnppq"] Jul 06 22:24:27.972106 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.972082 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 22:24:27.974882 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.974832 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hfhp"] Jul 06 22:24:27.977589 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.977483 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8"] Jul 06 22:24:27.977653 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.977622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:27.979338 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.979318 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6sz52"] Jul 06 22:24:27.979466 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.979447 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" Jul 06 22:24:27.980854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.980795 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:24:27.981111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.981093 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cqxg\"" Jul 06 22:24:27.981536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.981521 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84zzz"] Jul 06 22:24:27.981644 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.981627 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:24:27.981731 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.981642 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:27.983624 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.983603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-59gps"] Jul 06 22:24:27.983751 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.983680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:27.985747 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.985730 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.986866 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986012 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.987107 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986237 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tzl8n\"" Jul 06 22:24:27.989292 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.989274 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt"] Jul 06 22:24:27.989421 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986335 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:24:27.989635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986418 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:24:27.990027 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986458 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qlsf4\"" Jul 06 22:24:27.990366 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986495 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 22:24:27.990646 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986532 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lx5z8\"" Jul 06 22:24:27.990906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986573 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 22:24:27.994642 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.994627 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2"] Jul 06 22:24:27.994856 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.994843 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hfhp"] Jul 06 22:24:27.994968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.994958 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84zzz"] Jul 06 22:24:27.997060 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.997042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8"] Jul 06 22:24:28.001628 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.001614 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6sz52"] Jul 06 22:24:28.001777 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:27.986296 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.011378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.011413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.011484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.011545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b581c5-2f6a-4705-9790-a309edac9cbe-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2gn\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b581c5-2f6a-4705-9790-a309edac9cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lqv\" (UniqueName: \"kubernetes.io/projected/50b581c5-2f6a-4705-9790-a309edac9cbe-kube-api-access-t6lqv\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.012513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.012421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.113492 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/703017f9-2541-4f1a-ba91-e86a14a415f9-config\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.113602 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.113602 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113535 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-config\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.113602 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfa9be99-701e-497c-bbfc-0f33ffa9370d-serving-cert\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2gn\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-serving-cert\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmsq4\" (UniqueName: \"kubernetes.io/projected/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-kube-api-access-qmsq4\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f4e232c5-e087-46de-9396-f4808a2003ff-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.113785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113802 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxzdl\" (UniqueName: \"kubernetes.io/projected/dfa9be99-701e-497c-bbfc-0f33ffa9370d-kube-api-access-qxzdl\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mj2\" (UniqueName: \"kubernetes.io/projected/2a24c10e-0dc5-48f5-bbc6-df1331297b41-kube-api-access-q9mj2\") pod \"network-check-source-989f8b8dc-rl8k8\" (UID: \"2a24c10e-0dc5-48f5-bbc6-df1331297b41\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-default-certificate\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c275a3-b107-40ce-b6f0-abe35a13fb91-tmp-dir\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113875 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-cert\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.113991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.114111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114103 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwx4k\" (UniqueName: \"kubernetes.io/projected/b6c275a3-b107-40ce-b6f0-abe35a13fb91-kube-api-access-lwx4k\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjcm\" (UniqueName: \"kubernetes.io/projected/1298651d-6b05-425c-a95f-6fac0bf05db7-kube-api-access-txjcm\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2nc\" (UniqueName: \"kubernetes.io/projected/703017f9-2541-4f1a-ba91-e86a14a415f9-kube-api-access-6f2nc\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk9zb\" (UniqueName: \"kubernetes.io/projected/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-kube-api-access-tk9zb\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhlh\" (UniqueName: \"kubernetes.io/projected/7361691f-2c2d-4ed4-9c69-7399f919f0a0-kube-api-access-5lhlh\") pod \"volume-data-source-validator-5d456fdbcd-c9xdc\" (UID: \"7361691f-2c2d-4ed4-9c69-7399f919f0a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" Jul 06 22:24:28.114488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b581c5-2f6a-4705-9790-a309edac9cbe-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75145716-3545-4e92-95bf-51d2a676d1a9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b581c5-2f6a-4705-9790-a309edac9cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/703017f9-2541-4f1a-ba91-e86a14a415f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.114873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c275a3-b107-40ce-b6f0-abe35a13fb91-config-volume\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.115213 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-tmp\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.115213 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.114973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lqv\" (UniqueName: \"kubernetes.io/projected/50b581c5-2f6a-4705-9790-a309edac9cbe-kube-api-access-t6lqv\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.115213 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.115213 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.115213 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-stats-auth\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50b581c5-2f6a-4705-9790-a309edac9cbe-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-snapshots\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-trusted-ca\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xhr\" (UniqueName: \"kubernetes.io/projected/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-kube-api-access-g5xhr\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115420 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.115453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.115439 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp8zd\" (UniqueName: \"kubernetes.io/projected/75145716-3545-4e92-95bf-51d2a676d1a9-kube-api-access-fp8zd\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.115811 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.115510 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:28.115811 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.115524 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:28.115811 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.115582 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.615566045 +0000 UTC m=+36.039452738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:28.118548 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.118517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50b581c5-2f6a-4705-9790-a309edac9cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.118770 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.118750 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.118884 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.118790 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.122657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.122614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.122916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.122894 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2gn\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.124043 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.124016 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lqv\" (UniqueName: \"kubernetes.io/projected/50b581c5-2f6a-4705-9790-a309edac9cbe-kube-api-access-t6lqv\") pod \"kube-storage-version-migrator-operator-846bf668f7-x9v6b\" (UID: \"50b581c5-2f6a-4705-9790-a309edac9cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.216615 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhlh\" (UniqueName: \"kubernetes.io/projected/7361691f-2c2d-4ed4-9c69-7399f919f0a0-kube-api-access-5lhlh\") pod \"volume-data-source-validator-5d456fdbcd-c9xdc\" (UID: \"7361691f-2c2d-4ed4-9c69-7399f919f0a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" Jul 06 22:24:28.216615 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216602 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75145716-3545-4e92-95bf-51d2a676d1a9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.216827 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.216827 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/703017f9-2541-4f1a-ba91-e86a14a415f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.216827 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c275a3-b107-40ce-b6f0-abe35a13fb91-config-volume\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.216980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-tmp\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.216998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.217073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217026 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-stats-auth\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.217073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217053 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-snapshots\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-trusted-ca\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.217159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xhr\" (UniqueName: \"kubernetes.io/projected/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-kube-api-access-g5xhr\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.217159 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217152 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp8zd\" (UniqueName: \"kubernetes.io/projected/75145716-3545-4e92-95bf-51d2a676d1a9-kube-api-access-fp8zd\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/703017f9-2541-4f1a-ba91-e86a14a415f9-config\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217225 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.71720655 +0000 UTC m=+36.141093247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-config\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfa9be99-701e-497c-bbfc-0f33ffa9370d-serving-cert\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-serving-cert\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmsq4\" (UniqueName: \"kubernetes.io/projected/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-kube-api-access-qmsq4\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217394 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f4e232c5-e087-46de-9396-f4808a2003ff-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217435 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6c275a3-b107-40ce-b6f0-abe35a13fb91-config-volume\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217518 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217556 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.717543209 +0000 UTC m=+36.141429910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/75145716-3545-4e92-95bf-51d2a676d1a9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxzdl\" (UniqueName: \"kubernetes.io/projected/dfa9be99-701e-497c-bbfc-0f33ffa9370d-kube-api-access-qxzdl\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217598 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mj2\" (UniqueName: \"kubernetes.io/projected/2a24c10e-0dc5-48f5-bbc6-df1331297b41-kube-api-access-q9mj2\") pod \"network-check-source-989f8b8dc-rl8k8\" (UID: \"2a24c10e-0dc5-48f5-bbc6-df1331297b41\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217639 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:28.217685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-default-certificate\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.217697 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.717682133 +0000 UTC m=+36.141568811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217702 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/703017f9-2541-4f1a-ba91-e86a14a415f9-config\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c275a3-b107-40ce-b6f0-abe35a13fb91-tmp-dir\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-cert\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwx4k\" (UniqueName: \"kubernetes.io/projected/b6c275a3-b107-40ce-b6f0-abe35a13fb91-kube-api-access-lwx4k\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217888 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjcm\" (UniqueName: \"kubernetes.io/projected/1298651d-6b05-425c-a95f-6fac0bf05db7-kube-api-access-txjcm\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2nc\" (UniqueName: \"kubernetes.io/projected/703017f9-2541-4f1a-ba91-e86a14a415f9-kube-api-access-6f2nc\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217974 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6c275a3-b107-40ce-b6f0-abe35a13fb91-tmp-dir\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.217992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk9zb\" (UniqueName: \"kubernetes.io/projected/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-kube-api-access-tk9zb\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.218061 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.218100 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.718086902 +0000 UTC m=+36.141973583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.218240 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-config\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.218325 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:28.218364 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.218375 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.718361162 +0000 UTC m=+36.142247847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:28.219206 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.218699 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:28.718683625 +0000 UTC m=+36.142570326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:28.219206 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.219150 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-trusted-ca\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.219687 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.219618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/703017f9-2541-4f1a-ba91-e86a14a415f9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.219833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.219812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-snapshots\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.220035 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.220013 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dfa9be99-701e-497c-bbfc-0f33ffa9370d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.220869 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.220823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfa9be99-701e-497c-bbfc-0f33ffa9370d-tmp\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.221047 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.221008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-serving-cert\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.221143 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.221107 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-cert\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.221519 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.221495 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfa9be99-701e-497c-bbfc-0f33ffa9370d-serving-cert\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.221606 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.221579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f4e232c5-e087-46de-9396-f4808a2003ff-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.222082 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.222054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-default-certificate\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.222657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.222638 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-stats-auth\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.226357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.226189 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxzdl\" (UniqueName: \"kubernetes.io/projected/dfa9be99-701e-497c-bbfc-0f33ffa9370d-kube-api-access-qxzdl\") pod \"insights-operator-5c847dcfc4-mktxb\" (UID: \"dfa9be99-701e-497c-bbfc-0f33ffa9370d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.226357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.226302 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhlh\" (UniqueName: \"kubernetes.io/projected/7361691f-2c2d-4ed4-9c69-7399f919f0a0-kube-api-access-5lhlh\") pod \"volume-data-source-validator-5d456fdbcd-c9xdc\" (UID: \"7361691f-2c2d-4ed4-9c69-7399f919f0a0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" Jul 06 22:24:28.228214 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.228175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk9zb\" (UniqueName: \"kubernetes.io/projected/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-kube-api-access-tk9zb\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.229920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.229856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwx4k\" (UniqueName: \"kubernetes.io/projected/b6c275a3-b107-40ce-b6f0-abe35a13fb91-kube-api-access-lwx4k\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.230025 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.230007 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2nc\" (UniqueName: \"kubernetes.io/projected/703017f9-2541-4f1a-ba91-e86a14a415f9-kube-api-access-6f2nc\") pod \"service-ca-operator-5d46d9ffd4-vjnv2\" (UID: \"703017f9-2541-4f1a-ba91-e86a14a415f9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.230086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.230027 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjcm\" (UniqueName: \"kubernetes.io/projected/1298651d-6b05-425c-a95f-6fac0bf05db7-kube-api-access-txjcm\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.230904 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.230883 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp8zd\" (UniqueName: \"kubernetes.io/projected/75145716-3545-4e92-95bf-51d2a676d1a9-kube-api-access-fp8zd\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.231203 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.231185 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xhr\" (UniqueName: \"kubernetes.io/projected/29117865-f4b4-4cb9-be0a-684d7d7b2cb1-kube-api-access-g5xhr\") pod \"ingress-canary-84zzz\" (UID: \"29117865-f4b4-4cb9-be0a-684d7d7b2cb1\") " pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.231294 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.231274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mj2\" (UniqueName: \"kubernetes.io/projected/2a24c10e-0dc5-48f5-bbc6-df1331297b41-kube-api-access-q9mj2\") pod \"network-check-source-989f8b8dc-rl8k8\" (UID: \"2a24c10e-0dc5-48f5-bbc6-df1331297b41\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" Jul 06 22:24:28.231893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.231869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" Jul 06 22:24:28.232501 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.232480 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmsq4\" (UniqueName: \"kubernetes.io/projected/9fcf9833-ef22-4dd9-866c-6a65cae2c31d-kube-api-access-qmsq4\") pod \"console-operator-68b757fb67-59gps\" (UID: \"9fcf9833-ef22-4dd9-866c-6a65cae2c31d\") " pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.253652 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.253620 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" Jul 06 22:24:28.281477 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.281446 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" Jul 06 22:24:28.312172 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.311837 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:28.336793 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.331128 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" Jul 06 22:24:28.344576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.344548 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" Jul 06 22:24:28.358784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.358376 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84zzz" Jul 06 22:24:28.426325 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.426212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b"] Jul 06 22:24:28.431210 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.430244 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc"] Jul 06 22:24:28.437956 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.434764 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7361691f_2c2d_4ed4_9c69_7399f919f0a0.slice/crio-d539121388ab9285aaf77d1b57c87b1cbeb7708f2ab4f3dd9a8ad6d167ff3322 WatchSource:0}: Error finding container d539121388ab9285aaf77d1b57c87b1cbeb7708f2ab4f3dd9a8ad6d167ff3322: Status 404 returned error can't find the container with id d539121388ab9285aaf77d1b57c87b1cbeb7708f2ab4f3dd9a8ad6d167ff3322 Jul 06 22:24:28.437956 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.435558 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b581c5_2f6a_4705_9790_a309edac9cbe.slice/crio-4ef26a76203f2db38207762a027f60dd240959150b8052a9532dc81fb630fefb WatchSource:0}: Error finding container 4ef26a76203f2db38207762a027f60dd240959150b8052a9532dc81fb630fefb: Status 404 returned error can't find the container with id 4ef26a76203f2db38207762a027f60dd240959150b8052a9532dc81fb630fefb Jul 06 22:24:28.483125 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.483092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mktxb"] Jul 06 22:24:28.488802 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.486109 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa9be99_701e_497c_bbfc_0f33ffa9370d.slice/crio-2564133d94b44f2df09febc3a28b4b58269ef973c3cb735002dd3b77e7067ff6 WatchSource:0}: Error finding container 2564133d94b44f2df09febc3a28b4b58269ef973c3cb735002dd3b77e7067ff6: Status 404 returned error can't find the container with id 2564133d94b44f2df09febc3a28b4b58269ef973c3cb735002dd3b77e7067ff6 Jul 06 22:24:28.515119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.515092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-59gps"] Jul 06 22:24:28.520865 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.520797 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcf9833_ef22_4dd9_866c_6a65cae2c31d.slice/crio-9b246ff28e9fd073906ad646d22292bd860a40a7c01041c6e6ff77e7c88e6f49 WatchSource:0}: Error finding container 9b246ff28e9fd073906ad646d22292bd860a40a7c01041c6e6ff77e7c88e6f49: Status 404 returned error can't find the container with id 9b246ff28e9fd073906ad646d22292bd860a40a7c01041c6e6ff77e7c88e6f49 Jul 06 22:24:28.544693 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.544632 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8"] Jul 06 22:24:28.550209 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.550174 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a24c10e_0dc5_48f5_bbc6_df1331297b41.slice/crio-96f9a86e2df4d9ba1d78589ef30cb92cc7921b7df18867efcce4171aa0fef077 WatchSource:0}: Error finding container 96f9a86e2df4d9ba1d78589ef30cb92cc7921b7df18867efcce4171aa0fef077: Status 404 returned error can't find the container with id 96f9a86e2df4d9ba1d78589ef30cb92cc7921b7df18867efcce4171aa0fef077 Jul 06 22:24:28.558337 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.558249 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2"] Jul 06 22:24:28.560627 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.560597 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703017f9_2541_4f1a_ba91_e86a14a415f9.slice/crio-60db8fb5d6b9fe564fbb0442ac4d74615a3b6b7a3d27d03e16b1e139a7fc82fa WatchSource:0}: Error finding container 60db8fb5d6b9fe564fbb0442ac4d74615a3b6b7a3d27d03e16b1e139a7fc82fa: Status 404 returned error can't find the container with id 60db8fb5d6b9fe564fbb0442ac4d74615a3b6b7a3d27d03e16b1e139a7fc82fa Jul 06 22:24:28.570497 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.570474 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84zzz"] Jul 06 22:24:28.573563 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:28.573541 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29117865_f4b4_4cb9_be0a_684d7d7b2cb1.slice/crio-3a15dc65c91c2a93216aaac062d443a740ca1f51720b894bf2d5fc3fe35f19b5 WatchSource:0}: Error finding container 3a15dc65c91c2a93216aaac062d443a740ca1f51720b894bf2d5fc3fe35f19b5: Status 404 returned error can't find the container with id 3a15dc65c91c2a93216aaac062d443a740ca1f51720b894bf2d5fc3fe35f19b5 Jul 06 22:24:28.628245 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.628220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:28.628371 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.628353 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:28.628420 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.628373 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:28.628420 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.628419 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.628404995 +0000 UTC m=+37.052291672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:28.729704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:28.729704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729680 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.729877 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:28.729877 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:28.729877 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:28.729877 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:28.729856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:28.730075 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.729972 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:28.730075 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730018 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.730001809 +0000 UTC m=+37.153888500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:28.730308 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730251 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:28.730308 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730262 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:28.730308 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730281 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:28.730308 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730270 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:28.730513 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730319 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.73029334 +0000 UTC m=+37.154180039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:28.730513 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730338 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.730328561 +0000 UTC m=+37.154215246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:28.730513 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730353 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.730344316 +0000 UTC m=+37.154231001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:28.730513 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730367 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.730359458 +0000 UTC m=+37.154246136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:28.730513 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:28.730381 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:29.730373605 +0000 UTC m=+37.154260285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:29.025076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.024623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:29.025076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.024798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:29.025076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.024813 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:29.027557 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.027532 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:24:29.027700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.027532 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zvxv7\"" Jul 06 22:24:29.027700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.027594 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zhlqr\"" Jul 06 22:24:29.027700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.027571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:24:29.247292 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.247253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" event={"ID":"2a24c10e-0dc5-48f5-bbc6-df1331297b41","Type":"ContainerStarted","Data":"96f9a86e2df4d9ba1d78589ef30cb92cc7921b7df18867efcce4171aa0fef077"} Jul 06 22:24:29.252738 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.252690 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" event={"ID":"dfa9be99-701e-497c-bbfc-0f33ffa9370d","Type":"ContainerStarted","Data":"2564133d94b44f2df09febc3a28b4b58269ef973c3cb735002dd3b77e7067ff6"} Jul 06 22:24:29.254119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.254090 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" event={"ID":"7361691f-2c2d-4ed4-9c69-7399f919f0a0","Type":"ContainerStarted","Data":"d539121388ab9285aaf77d1b57c87b1cbeb7708f2ab4f3dd9a8ad6d167ff3322"} Jul 06 22:24:29.257145 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.257079 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" event={"ID":"50b581c5-2f6a-4705-9790-a309edac9cbe","Type":"ContainerStarted","Data":"4ef26a76203f2db38207762a027f60dd240959150b8052a9532dc81fb630fefb"} Jul 06 22:24:29.259594 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.259530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84zzz" event={"ID":"29117865-f4b4-4cb9-be0a-684d7d7b2cb1","Type":"ContainerStarted","Data":"3a15dc65c91c2a93216aaac062d443a740ca1f51720b894bf2d5fc3fe35f19b5"} Jul 06 22:24:29.261852 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.261785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" event={"ID":"703017f9-2541-4f1a-ba91-e86a14a415f9","Type":"ContainerStarted","Data":"60db8fb5d6b9fe564fbb0442ac4d74615a3b6b7a3d27d03e16b1e139a7fc82fa"} Jul 06 22:24:29.263546 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.263494 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-59gps" event={"ID":"9fcf9833-ef22-4dd9-866c-6a65cae2c31d","Type":"ContainerStarted","Data":"9b246ff28e9fd073906ad646d22292bd860a40a7c01041c6e6ff77e7c88e6f49"} Jul 06 22:24:29.645431 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.644802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:29.645431 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.644977 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:29.645431 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.644992 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:29.645431 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.645053 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.645031906 +0000 UTC m=+39.068918604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:29.734037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.733966 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.745980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.746047 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.746084 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.746122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746163 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.746167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.746223 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746272 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746253417 +0000 UTC m=+39.170140112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746325 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746365 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746352885 +0000 UTC m=+39.170239563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746416 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746445 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746435429 +0000 UTC m=+39.170322107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746497 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746539 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746527786 +0000 UTC m=+39.170414463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:29.746645 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746605 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:29.747451 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746627 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746616486 +0000 UTC m=+39.170503180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:29.747451 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:29.746644 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:31.746635768 +0000 UTC m=+39.170522447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:29.824312 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:29.824282 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:31.664298 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.664264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:31.664654 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.664415 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:31.664654 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.664433 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:31.664654 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.664488 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.664473257 +0000 UTC m=+43.088359935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:31.765575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:31.765749 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:31.765749 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:31.765749 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765701 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765775 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.765760594 +0000 UTC m=+43.189647273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765796 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765811 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.765791745 +0000 UTC m=+43.189678431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765796 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765838 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.765825916 +0000 UTC m=+43.189712604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:31.765893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765908 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.765885417 +0000 UTC m=+43.189772099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765919 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.765956 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.765946752 +0000 UTC m=+43.189833435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:31.765968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.766035 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:31.766118 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:31.766061 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:35.766054491 +0000 UTC m=+43.189941168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:33.379249 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:33.379175 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:33.438700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:33.438663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:34.462948 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:34.462896 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:34.521653 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:34.521623 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:35.704640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.704556 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:35.705051 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.704737 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:35.705051 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.704757 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:35.705051 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.704816 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.704797442 +0000 UTC m=+51.128684120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:35.805990 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.805948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:35.806168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.806016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:35.806168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.806058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:35.806168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.806093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:35.806168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.806124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:35.806186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806126 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806235 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806188 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806207 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806284 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.806262172 +0000 UTC m=+51.230148865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806299 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806312 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.8062977 +0000 UTC m=+51.230184390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806331 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.806320914 +0000 UTC m=+51.230207592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806344 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.806336744 +0000 UTC m=+51.230223422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806357 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.806349894 +0000 UTC m=+51.230236573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:35.806380 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:35.806374 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:43.806365613 +0000 UTC m=+51.230252295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:37.446325 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:37.446230 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:37.557138 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:37.557105 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:38.290348 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.290322 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/0.log" Jul 06 22:24:38.290501 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.290360 2568 generic.go:356] "Generic (PLEG): container finished" podID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" containerID="97dbe6f5d6a3d27ec29a1e17ae2ae9162d689a740f5118e1d4c9cef36399f8d3" exitCode=255 Jul 06 22:24:38.290501 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.290441 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-59gps" event={"ID":"9fcf9833-ef22-4dd9-866c-6a65cae2c31d","Type":"ContainerDied","Data":"97dbe6f5d6a3d27ec29a1e17ae2ae9162d689a740f5118e1d4c9cef36399f8d3"} Jul 06 22:24:38.290804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.290778 2568 scope.go:117] "RemoveContainer" containerID="97dbe6f5d6a3d27ec29a1e17ae2ae9162d689a740f5118e1d4c9cef36399f8d3" Jul 06 22:24:38.293692 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.293666 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="3f9b976c9acd1c5a91d44f28f29a83b68fc1a58755453e6f12f6f3702ca51185" exitCode=0 Jul 06 22:24:38.293824 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.293739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"3f9b976c9acd1c5a91d44f28f29a83b68fc1a58755453e6f12f6f3702ca51185"} Jul 06 22:24:38.295822 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.295795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" event={"ID":"2a24c10e-0dc5-48f5-bbc6-df1331297b41","Type":"ContainerStarted","Data":"e7a3fb36d280850a77f1b8ea9c977c6125cec4cdf10a319c8ec197fc5547f644"} Jul 06 22:24:38.297364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.297334 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" event={"ID":"dfa9be99-701e-497c-bbfc-0f33ffa9370d","Type":"ContainerStarted","Data":"1b9d06271da6bfb706cee7f1615184bef45df74242f5e8a2ff663cef442a8df6"} Jul 06 22:24:38.298849 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.298810 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" event={"ID":"7361691f-2c2d-4ed4-9c69-7399f919f0a0","Type":"ContainerStarted","Data":"3987290a96986c810475bc9c455fdb433e7b63bebdecffbf0cb9464d6ccfeb70"} Jul 06 22:24:38.300315 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.300294 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" event={"ID":"50b581c5-2f6a-4705-9790-a309edac9cbe","Type":"ContainerStarted","Data":"18c07eba70bf6a94b4437a3ee1fd65b91f5e58a9e115b4e915729d19cc945f5c"} Jul 06 22:24:38.302622 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.302602 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84zzz" event={"ID":"29117865-f4b4-4cb9-be0a-684d7d7b2cb1","Type":"ContainerStarted","Data":"808247dbf9a288b201e7203265fddbe0687bfa6c203da2632a06429d90d9ee0f"} Jul 06 22:24:38.304187 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.304170 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" event={"ID":"703017f9-2541-4f1a-ba91-e86a14a415f9","Type":"ContainerStarted","Data":"a3de0f5f56a769dffcaf1397d196c705bcb5764a9210acc70af9f443962441b7"} Jul 06 22:24:38.313013 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.312995 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:38.313086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.313031 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:38.324616 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.324562 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" podStartSLOduration=22.657773405 podStartE2EDuration="31.324547344s" totalImagesPullingTime="8.666773939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.323910907 +0000 UTC m=+45.747797609" watchObservedRunningTime="2026-07-06 22:24:38.324547344 +0000 UTC m=+45.748434047" Jul 06 22:24:38.339217 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.339174 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-rl8k8" podStartSLOduration=9.710791074 podStartE2EDuration="18.339158516s" totalImagesPullingTime="8.628367442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.337960812 +0000 UTC m=+45.761847513" watchObservedRunningTime="2026-07-06 22:24:38.339158516 +0000 UTC m=+45.763045216" Jul 06 22:24:38.387929 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.387881 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-c9xdc" podStartSLOduration=15.671357164 podStartE2EDuration="24.387863747s" totalImagesPullingTime="8.716506583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.355522459 +0000 UTC m=+45.779409160" watchObservedRunningTime="2026-07-06 22:24:38.387863747 +0000 UTC m=+45.811750448" Jul 06 22:24:38.409476 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.408831 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" podStartSLOduration=22.691268385 podStartE2EDuration="31.408811611s" totalImagesPullingTime="8.717543226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.405733907 +0000 UTC m=+45.829620604" watchObservedRunningTime="2026-07-06 22:24:38.408811611 +0000 UTC m=+45.832698312" Jul 06 22:24:38.441476 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.441395 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84zzz" podStartSLOduration=2.860423742 podStartE2EDuration="11.441375149s" totalImagesPullingTime="8.580951407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.438991761 +0000 UTC m=+45.862878463" watchObservedRunningTime="2026-07-06 22:24:38.441375149 +0000 UTC m=+45.865261832" Jul 06 22:24:38.459494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.458447 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" podStartSLOduration=12.834535926000001 podStartE2EDuration="21.458429934s" totalImagesPullingTime="8.623894008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:38.458044611 +0000 UTC m=+45.881931308" watchObservedRunningTime="2026-07-06 22:24:38.458429934 +0000 UTC m=+45.882316636" Jul 06 22:24:38.471984 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.471873 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:38.573054 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.572986 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:38.794399 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.794364 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:38.887142 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.887108 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:38.960172 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:38.960138 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:39.030847 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.030816 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:39.040768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.040740 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rvgzk"] Jul 06 22:24:39.063134 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.063045 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvgzk"] Jul 06 22:24:39.063254 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.063155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.066046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.066029 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:24:39.066296 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.066266 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9tvqz\"" Jul 06 22:24:39.066404 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.066299 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:24:39.094490 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.094465 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:39.132935 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.132911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78da5cd8-2770-46b9-b0a9-428df8899c61-crio-socket\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.133014 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.132937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skz5h\" (UniqueName: \"kubernetes.io/projected/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-api-access-skz5h\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.133014 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.132960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.133014 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.133003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78da5cd8-2770-46b9-b0a9-428df8899c61-data-volume\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.133132 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.133023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233528 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78da5cd8-2770-46b9-b0a9-428df8899c61-crio-socket\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skz5h\" (UniqueName: \"kubernetes.io/projected/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-api-access-skz5h\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78da5cd8-2770-46b9-b0a9-428df8899c61-data-volume\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233849 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233744 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78da5cd8-2770-46b9-b0a9-428df8899c61-crio-socket\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.233849 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.233766 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:39.233849 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.233826 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:39.733808949 +0000 UTC m=+47.157695646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : configmap "kube-rbac-proxy" not found Jul 06 22:24:39.234010 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.233990 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78da5cd8-2770-46b9-b0a9-428df8899c61-data-volume\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.234078 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.234064 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:39.234127 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.234117 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:39.734102015 +0000 UTC m=+47.157988693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:39.244319 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.244300 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skz5h\" (UniqueName: \"kubernetes.io/projected/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-api-access-skz5h\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.310580 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.310560 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:24:39.311062 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.311049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/0.log" Jul 06 22:24:39.311121 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.311082 2568 generic.go:356] "Generic (PLEG): container finished" podID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" exitCode=255 Jul 06 22:24:39.311167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.311110 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-59gps" event={"ID":"9fcf9833-ef22-4dd9-866c-6a65cae2c31d","Type":"ContainerDied","Data":"a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e"} Jul 06 22:24:39.313858 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.313810 2568 generic.go:356] "Generic (PLEG): container finished" podID="97b6b946-f277-42dd-a372-ad3704a29af1" containerID="d596f87c4368fcb6a1bd71a66551dd35d556ad2096f1c4dd95eece12fe3072ae" exitCode=0 Jul 06 22:24:39.313947 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.313909 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerDied","Data":"d596f87c4368fcb6a1bd71a66551dd35d556ad2096f1c4dd95eece12fe3072ae"} Jul 06 22:24:39.324806 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.324787 2568 scope.go:117] "RemoveContainer" containerID="97dbe6f5d6a3d27ec29a1e17ae2ae9162d689a740f5118e1d4c9cef36399f8d3" Jul 06 22:24:39.324905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.324891 2568 scope.go:117] "RemoveContainer" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" Jul 06 22:24:39.325067 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.325041 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-59gps_openshift-console-operator(9fcf9833-ef22-4dd9-866c-6a65cae2c31d)\"" pod="openshift-console-operator/console-operator-68b757fb67-59gps" podUID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" Jul 06 22:24:39.497510 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.497482 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:39.597960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.597895 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:39.737993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.737965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.738113 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:39.737997 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:39.738113 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.738062 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:39.738113 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.738100 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:40.738089409 +0000 UTC m=+48.161976101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : configmap "kube-rbac-proxy" not found Jul 06 22:24:39.738275 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.738111 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:39.738486 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:39.738464 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:40.738243763 +0000 UTC m=+48.162130445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:40.320286 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.320258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:24:40.320635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.320614 2568 scope.go:117] "RemoveContainer" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" Jul 06 22:24:40.320994 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:40.320965 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-59gps_openshift-console-operator(9fcf9833-ef22-4dd9-866c-6a65cae2c31d)\"" pod="openshift-console-operator/console-operator-68b757fb67-59gps" podUID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" Jul 06 22:24:40.323586 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.323562 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" event={"ID":"97b6b946-f277-42dd-a372-ad3704a29af1","Type":"ContainerStarted","Data":"7017ee26c2437e56b990f328b21b30ab48a4cc59269982f33fa11e2c88256d65"} Jul 06 22:24:40.359855 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.359803 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bp7p4" podStartSLOduration=11.231251436 podStartE2EDuration="46.359789787s" totalImagesPullingTime="35.128538351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:40.359047219 +0000 UTC m=+47.782933920" watchObservedRunningTime="2026-07-06 22:24:40.359789787 +0000 UTC m=+47.783676486" Jul 06 22:24:40.481605 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.481567 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:40.581961 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.581887 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:40.747408 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.747382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:40.747549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:40.747412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:40.747549 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:40.747479 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:40.747549 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:40.747513 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:40.747549 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:40.747526 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:42.747513496 +0000 UTC m=+50.171400173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : configmap "kube-rbac-proxy" not found Jul 06 22:24:40.747686 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:40.747563 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:42.747549965 +0000 UTC m=+50.171436647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:41.158547 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:41.158516 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:41.212626 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:41.212597 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:41.630536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:41.630511 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5djdn_809634c9-67e6-45fd-abb6-4908b9f11684/dns-node-resolver/0.log" Jul 06 22:24:42.017605 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:42.017576 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:42.763393 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:42.763359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:42.763393 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:42.763395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:42.763959 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:42.763531 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:42.763959 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:42.763602 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:46.763582477 +0000 UTC m=+54.187469170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:42.763959 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:42.763604 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:24:42.763959 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:42.763646 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:46.763635051 +0000 UTC m=+54.187521729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : configmap "kube-rbac-proxy" not found Jul 06 22:24:42.829127 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:42.829103 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pnl72_b42a6238-f202-4ebe-8abe-379c0c2c9bfc/node-ca/0.log" Jul 06 22:24:43.608210 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.608177 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:43.629469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.629442 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84zzz_29117865-f4b4-4cb9-be0a-684d7d7b2cb1/serve-healthcheck-canary/0.log" Jul 06 22:24:43.772275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.772243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:43.772679 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.772369 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:24:43.772679 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.772386 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5c798ffd-vgtll: secret "image-registry-tls" not found Jul 06 22:24:43.772679 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.772449 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls podName:cf65c38c-84a7-4579-9bba-80c08192be90 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.7724321 +0000 UTC m=+67.196318791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls") pod "image-registry-7c5c798ffd-vgtll" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90") : secret "image-registry-tls" not found Jul 06 22:24:43.873443 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:43.873560 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873461 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:43.873560 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873389 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:24:43.873560 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873518 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls podName:b6c275a3-b107-40ce-b6f0-abe35a13fb91 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873506023 +0000 UTC m=+67.297392701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls") pod "dns-default-6hfhp" (UID: "b6c275a3-b107-40ce-b6f0-abe35a13fb91") : secret "dns-default-metrics-tls" not found Jul 06 22:24:43.873560 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873618 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873681 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls podName:75145716-3545-4e92-95bf-51d2a676d1a9 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873666405 +0000 UTC m=+67.297553101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-j57jt" (UID: "75145716-3545-4e92-95bf-51d2a676d1a9") : secret "cluster-monitoring-operator-tls" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873707 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873727 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.873758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873782 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873793 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873778048 +0000 UTC m=+67.297664745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : secret "router-metrics-certs-default" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873817 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls podName:1298651d-6b05-425c-a95f-6fac0bf05db7 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873803665 +0000 UTC m=+67.297690343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h44z2" (UID: "1298651d-6b05-425c-a95f-6fac0bf05db7") : secret "samples-operator-tls" not found Jul 06 22:24:43.873838 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873834 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert podName:f4e232c5-e087-46de-9396-f4808a2003ff nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873825554 +0000 UTC m=+67.297712232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6sz52" (UID: "f4e232c5-e087-46de-9396-f4808a2003ff") : secret "networking-console-plugin-cert" not found Jul 06 22:24:43.874190 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:43.873854 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle podName:b0472d95-0970-4d8d-8adb-de2f7f9eb1e2 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:59.873845479 +0000 UTC m=+67.297732157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle") pod "router-default-6b777fbb4c-rnppq" (UID: "b0472d95-0970-4d8d-8adb-de2f7f9eb1e2") : configmap references non-existent config key: service-ca.crt Jul 06 22:24:43.913264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:43.913242 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:44.431353 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:44.431324 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x9v6b_50b581c5-2f6a-4705-9790-a309edac9cbe/kube-storage-version-migrator-operator/0.log" Jul 06 22:24:45.229360 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:45.229328 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:45.328061 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:45.328033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:45.633802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:45.633776 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:45.734370 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:45.734344 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:45.835351 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:45.835317 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:46.031216 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:46.031193 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:46.798332 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:46.798304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:46.798332 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:46.798337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:46.798963 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:46.798470 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:24:46.798963 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:46.798528 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls podName:78da5cd8-2770-46b9-b0a9-428df8899c61 nodeName:}" failed. No retries permitted until 2026-07-06 22:24:54.798513417 +0000 UTC m=+62.222400099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvgzk" (UID: "78da5cd8-2770-46b9-b0a9-428df8899c61") : secret "insights-runtime-extractor-tls" not found Jul 06 22:24:46.799079 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:46.799018 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78da5cd8-2770-46b9-b0a9-428df8899c61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:46.840895 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:46.840869 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:47.229037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:47.228970 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:47.631417 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:47.631377 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:47.857914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:47.857886 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:48.227051 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.227025 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:48.312557 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.312534 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:48.312665 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.312631 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:24:48.312942 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.312921 2568 scope.go:117] "RemoveContainer" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" Jul 06 22:24:48.313079 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:48.313062 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-59gps_openshift-console-operator(9fcf9833-ef22-4dd9-866c-6a65cae2c31d)\"" pod="openshift-console-operator/console-operator-68b757fb67-59gps" podUID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" Jul 06 22:24:48.347462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.347443 2568 scope.go:117] "RemoveContainer" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" Jul 06 22:24:48.347586 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:24:48.347571 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-59gps_openshift-console-operator(9fcf9833-ef22-4dd9-866c-6a65cae2c31d)\"" pod="openshift-console-operator/console-operator-68b757fb67-59gps" podUID="9fcf9833-ef22-4dd9-866c-6a65cae2c31d" Jul 06 22:24:48.832983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:48.832956 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:49.005148 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:49.005118 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:49.426791 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:49.426755 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:49.481016 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:49.480994 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:49.632229 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:49.632206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:50.035405 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:50.035374 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:50.253061 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:50.253033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:50.326337 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:50.326269 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:50.829503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:50.829475 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:51.429681 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:51.429650 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:51.725410 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:51.725341 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:52.025530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:52.025501 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:52.227560 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:52.227526 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:52.613575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:52.613549 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:52.831802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:52.831780 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.233431 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.233404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.241829 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.241808 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kbgh" Jul 06 22:24:53.452055 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.452030 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.511725 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.511685 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.632116 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.632090 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.804288 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.804218 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:53.859502 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:53.859480 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:54.230604 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:54.230547 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:54.860349 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:54.860320 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:54.862579 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:54.862560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78da5cd8-2770-46b9-b0a9-428df8899c61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvgzk\" (UID: \"78da5cd8-2770-46b9-b0a9-428df8899c61\") " pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:54.975571 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:54.975552 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9tvqz\"" Jul 06 22:24:54.983896 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:54.983877 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvgzk" Jul 06 22:24:55.061242 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.061167 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:55.108611 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.108583 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvgzk"] Jul 06 22:24:55.111599 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:55.111558 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da5cd8_2770_46b9_b0a9_428df8899c61.slice/crio-187ea5942df7d5932652ca2fb4d3266e38b13f5db24c07f41e789cbe4f3e1e51 WatchSource:0}: Error finding container 187ea5942df7d5932652ca2fb4d3266e38b13f5db24c07f41e789cbe4f3e1e51: Status 404 returned error can't find the container with id 187ea5942df7d5932652ca2fb4d3266e38b13f5db24c07f41e789cbe4f3e1e51 Jul 06 22:24:55.367485 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.367419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvgzk" event={"ID":"78da5cd8-2770-46b9-b0a9-428df8899c61","Type":"ContainerStarted","Data":"187ea5942df7d5932652ca2fb4d3266e38b13f5db24c07f41e789cbe4f3e1e51"} Jul 06 22:24:55.439748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.439706 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:55.640044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.639855 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:55.825228 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:55.825140 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:56.023583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:56.023512 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:24:58.893957 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.893931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:58.894263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.893982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:58.894263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.894036 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:58.896404 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.896374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbctz\" (UniqueName: \"kubernetes.io/projected/83adf7f8-ee3f-428e-874c-aa1f6ad76587-kube-api-access-vbctz\") pod \"network-check-target-7dvvr\" (UID: \"83adf7f8-ee3f-428e-874c-aa1f6ad76587\") " pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:58.896763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.896745 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:24:58.897792 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.897774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:24:58.906683 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.906662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0668c2b5-b49e-4f1c-96e2-48abe887370b-original-pull-secret\") pod \"global-pull-secret-syncer-26bcb\" (UID: \"0668c2b5-b49e-4f1c-96e2-48abe887370b\") " pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:58.906808 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:58.906792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13808416-159f-475e-bfa8-00f2b0094637-metrics-certs\") pod \"network-metrics-daemon-vs77c\" (UID: \"13808416-159f-475e-bfa8-00f2b0094637\") " pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:59.044785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.044766 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zvxv7\"" Jul 06 22:24:59.051939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.051922 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-26bcb" Jul 06 22:24:59.053004 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.052988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:59.061405 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.061390 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zhlqr\"" Jul 06 22:24:59.069347 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.069329 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vs77c" Jul 06 22:24:59.216260 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.216232 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-26bcb"] Jul 06 22:24:59.220447 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:59.220418 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0668c2b5_b49e_4f1c_96e2_48abe887370b.slice/crio-0b49c43f5bbd3d66de7338f029c1ba5af40781e489f882e4c0ef887ae2a3dd1f WatchSource:0}: Error finding container 0b49c43f5bbd3d66de7338f029c1ba5af40781e489f882e4c0ef887ae2a3dd1f: Status 404 returned error can't find the container with id 0b49c43f5bbd3d66de7338f029c1ba5af40781e489f882e4c0ef887ae2a3dd1f Jul 06 22:24:59.234158 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.234132 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7dvvr"] Jul 06 22:24:59.237128 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:59.237106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83adf7f8_ee3f_428e_874c_aa1f6ad76587.slice/crio-ea814bfd62151a88d7f13b1306a9a0b041487f3f8866c96c4391aae7244e9b1e WatchSource:0}: Error finding container ea814bfd62151a88d7f13b1306a9a0b041487f3f8866c96c4391aae7244e9b1e: Status 404 returned error can't find the container with id ea814bfd62151a88d7f13b1306a9a0b041487f3f8866c96c4391aae7244e9b1e Jul 06 22:24:59.252645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.252620 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vs77c"] Jul 06 22:24:59.255671 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:24:59.255648 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13808416_159f_475e_bfa8_00f2b0094637.slice/crio-37909b69630c8d77c1c8d504204dac1753ebfa4eba15cf42993bb4ffcfeb7697 WatchSource:0}: Error finding container 37909b69630c8d77c1c8d504204dac1753ebfa4eba15cf42993bb4ffcfeb7697: Status 404 returned error can't find the container with id 37909b69630c8d77c1c8d504204dac1753ebfa4eba15cf42993bb4ffcfeb7697 Jul 06 22:24:59.383575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.383519 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvgzk" event={"ID":"78da5cd8-2770-46b9-b0a9-428df8899c61","Type":"ContainerStarted","Data":"8a604c0aee8864e41abe20b75280d6749d677d8b81e534d64902f3dd3175e8f2"} Jul 06 22:24:59.384638 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.384620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vs77c" event={"ID":"13808416-159f-475e-bfa8-00f2b0094637","Type":"ContainerStarted","Data":"37909b69630c8d77c1c8d504204dac1753ebfa4eba15cf42993bb4ffcfeb7697"} Jul 06 22:24:59.386042 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.386010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7dvvr" event={"ID":"83adf7f8-ee3f-428e-874c-aa1f6ad76587","Type":"ContainerStarted","Data":"9115ddb971bd9beccbaa5ea52f7a6dc2eac95eae3e4c1b1766866747292913b8"} Jul 06 22:24:59.386150 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.386047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7dvvr" event={"ID":"83adf7f8-ee3f-428e-874c-aa1f6ad76587","Type":"ContainerStarted","Data":"ea814bfd62151a88d7f13b1306a9a0b041487f3f8866c96c4391aae7244e9b1e"} Jul 06 22:24:59.386150 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.386074 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:24:59.387099 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.387076 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26bcb" event={"ID":"0668c2b5-b49e-4f1c-96e2-48abe887370b","Type":"ContainerStarted","Data":"0b49c43f5bbd3d66de7338f029c1ba5af40781e489f882e4c0ef887ae2a3dd1f"} Jul 06 22:24:59.400155 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.400034 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7dvvr" podStartSLOduration=65.40002064 podStartE2EDuration="1m5.40002064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:24:59.39969738 +0000 UTC m=+66.823584091" watchObservedRunningTime="2026-07-06 22:24:59.40002064 +0000 UTC m=+66.823907340" Jul 06 22:24:59.802504 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.802476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:59.804635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.804617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"image-registry-7c5c798ffd-vgtll\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903485 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:59.903807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.903610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:59.904463 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.904160 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-service-ca-bundle\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:59.906519 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.906491 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6c275a3-b107-40ce-b6f0-abe35a13fb91-metrics-tls\") pod \"dns-default-6hfhp\" (UID: \"b6c275a3-b107-40ce-b6f0-abe35a13fb91\") " pod="openshift-dns/dns-default-6hfhp" Jul 06 22:24:59.906645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.906593 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1298651d-6b05-425c-a95f-6fac0bf05db7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h44z2\" (UID: \"1298651d-6b05-425c-a95f-6fac0bf05db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:24:59.907007 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.906983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0472d95-0970-4d8d-8adb-de2f7f9eb1e2-metrics-certs\") pod \"router-default-6b777fbb4c-rnppq\" (UID: \"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2\") " pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:24:59.907123 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.907058 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4e232c5-e087-46de-9396-f4808a2003ff-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6sz52\" (UID: \"f4e232c5-e087-46de-9396-f4808a2003ff\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:24:59.907457 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:24:59.907438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/75145716-3545-4e92-95bf-51d2a676d1a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-j57jt\" (UID: \"75145716-3545-4e92-95bf-51d2a676d1a9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:25:00.046042 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.046008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c4gjv\"" Jul 06 22:25:00.054470 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.054283 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:25:00.077428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.077010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-czmpl\"" Jul 06 22:25:00.077428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.077266 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nhwxz\"" Jul 06 22:25:00.085668 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.085365 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" Jul 06 22:25:00.085668 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.085586 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:25:00.126572 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.126358 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pvljq\"" Jul 06 22:25:00.139150 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.134649 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" Jul 06 22:25:00.139675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.139653 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2cqxg\"" Jul 06 22:25:00.148176 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.148009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hfhp" Jul 06 22:25:00.154820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.154313 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lx5z8\"" Jul 06 22:25:00.163068 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.161751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" Jul 06 22:25:00.247168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.247136 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:25:00.301546 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.301336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2"] Jul 06 22:25:00.318556 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.318220 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b777fbb4c-rnppq"] Jul 06 22:25:00.383654 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.383607 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hfhp"] Jul 06 22:25:00.399326 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.399248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvgzk" event={"ID":"78da5cd8-2770-46b9-b0a9-428df8899c61","Type":"ContainerStarted","Data":"bf2968b38a5a52d26da174854e2bb7a014facca27226aa36fad1c683dbeb1a28"} Jul 06 22:25:00.592162 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:00.592123 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0472d95_0970_4d8d_8adb_de2f7f9eb1e2.slice/crio-76bfcc5f36e445e01be691382ef255c673a64c123a5361ed6489e2d79dc12c40 WatchSource:0}: Error finding container 76bfcc5f36e445e01be691382ef255c673a64c123a5361ed6489e2d79dc12c40: Status 404 returned error can't find the container with id 76bfcc5f36e445e01be691382ef255c673a64c123a5361ed6489e2d79dc12c40 Jul 06 22:25:00.638453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.638351 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6sz52"] Jul 06 22:25:00.639807 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.639782 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt"] Jul 06 22:25:00.650033 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:00.649991 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75145716_3545_4e92_95bf_51d2a676d1a9.slice/crio-93ad05e5b172304fb62bfa705a50a98a6cced0a0fe7f6ce523942e5f9894d3f8 WatchSource:0}: Error finding container 93ad05e5b172304fb62bfa705a50a98a6cced0a0fe7f6ce523942e5f9894d3f8: Status 404 returned error can't find the container with id 93ad05e5b172304fb62bfa705a50a98a6cced0a0fe7f6ce523942e5f9894d3f8 Jul 06 22:25:00.787296 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.787170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:00.875780 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.875623 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:00.975584 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:00.975553 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:01.074587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.074535 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:01.407006 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.406973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" event={"ID":"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2","Type":"ContainerStarted","Data":"c03db2122ae716fed0df1d44724cd22cf4668d3b5b11ced5e42f73e69380ed9d"} Jul 06 22:25:01.407185 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.407027 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" event={"ID":"b0472d95-0970-4d8d-8adb-de2f7f9eb1e2","Type":"ContainerStarted","Data":"76bfcc5f36e445e01be691382ef255c673a64c123a5361ed6489e2d79dc12c40"} Jul 06 22:25:01.413190 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.412383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" event={"ID":"1298651d-6b05-425c-a95f-6fac0bf05db7","Type":"ContainerStarted","Data":"e870cda46bef969ca4eee219cb8059e45be3335991e5fce5b6ed4b7fd4b44f54"} Jul 06 22:25:01.415460 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.415374 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hfhp" event={"ID":"b6c275a3-b107-40ce-b6f0-abe35a13fb91","Type":"ContainerStarted","Data":"45fc5cff1f29ecb130b5f349c5462ef5499833c4e1a79760ccaa141d10b4ecc0"} Jul 06 22:25:01.417002 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.416929 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" event={"ID":"75145716-3545-4e92-95bf-51d2a676d1a9","Type":"ContainerStarted","Data":"93ad05e5b172304fb62bfa705a50a98a6cced0a0fe7f6ce523942e5f9894d3f8"} Jul 06 22:25:01.420469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.420445 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vs77c" event={"ID":"13808416-159f-475e-bfa8-00f2b0094637","Type":"ContainerStarted","Data":"8177801c1ee55b2f34b137b64ccf14a31407c8de464e1d80b9b954a3248ee768"} Jul 06 22:25:01.420576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.420495 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vs77c" event={"ID":"13808416-159f-475e-bfa8-00f2b0094637","Type":"ContainerStarted","Data":"cd25d97f776c0f6160d69bab7a8ff45084ad61ad4c43471b1db360794a1edfa4"} Jul 06 22:25:01.422588 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.422552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" event={"ID":"f4e232c5-e087-46de-9396-f4808a2003ff","Type":"ContainerStarted","Data":"52776ba96526b92bbaa3d98959702eadf89aa8087da07cda2167b042342035eb"} Jul 06 22:25:01.424624 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.424575 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" event={"ID":"cf65c38c-84a7-4579-9bba-80c08192be90","Type":"ContainerStarted","Data":"f1f904317990b96cc47806c56888eb4c169a8f8beb342517853d9927d90a6fa1"} Jul 06 22:25:01.424624 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.424613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" event={"ID":"cf65c38c-84a7-4579-9bba-80c08192be90","Type":"ContainerStarted","Data":"21fee7a707e1858b84fcf9d5cd9c3a6a46df7ddfa6afc7630743bf0bf0ed973b"} Jul 06 22:25:01.425146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.425090 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:25:01.453275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.451852 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vs77c" podStartSLOduration=66.051958691 podStartE2EDuration="1m7.451834053s" totalImagesPullingTime="1.399875362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:01.451641788 +0000 UTC m=+68.875528491" watchObservedRunningTime="2026-07-06 22:25:01.451834053 +0000 UTC m=+68.875720754" Jul 06 22:25:01.453275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.452516 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" podStartSLOduration=54.452505493 podStartE2EDuration="54.452505493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:01.431283789 +0000 UTC m=+68.855170492" watchObservedRunningTime="2026-07-06 22:25:01.452505493 +0000 UTC m=+68.876392195" Jul 06 22:25:01.476297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.475492 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" podStartSLOduration=67.475475487 podStartE2EDuration="1m7.475475487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:01.474050791 +0000 UTC m=+68.897937494" watchObservedRunningTime="2026-07-06 22:25:01.475475487 +0000 UTC m=+68.899362188" Jul 06 22:25:01.668835 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:01.668726 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:02.087899 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.086639 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:25:02.090296 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.090098 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:25:02.310633 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.310564 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:02.372741 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.372586 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:02.432169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.431975 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:25:02.433334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:02.433313 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b777fbb4c-rnppq" Jul 06 22:25:04.020062 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:04.020032 2568 scope.go:117] "RemoveContainer" containerID="a7c9ec66e9276bc4a225d3bfab3954559fd9dda187117d80bf93d37e80972c7e" Jul 06 22:25:04.795706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:04.795672 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:04.898191 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:04.898164 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.278152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.278083 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.378247 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.378137 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.432000 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.431973 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.450019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.449994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hfhp" event={"ID":"b6c275a3-b107-40ce-b6f0-abe35a13fb91","Type":"ContainerStarted","Data":"37656ef8b378e14cf4c229021d130ea79ccf5a20b83d388bc1349790cfc3f3ab"} Jul 06 22:25:07.450154 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.450045 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hfhp" event={"ID":"b6c275a3-b107-40ce-b6f0-abe35a13fb91","Type":"ContainerStarted","Data":"bde666c95702cf7df65aec98806925ed5500065112eb85fdc3caac3fd99244be"} Jul 06 22:25:07.450154 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.450116 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hfhp" Jul 06 22:25:07.451703 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.451682 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" event={"ID":"75145716-3545-4e92-95bf-51d2a676d1a9","Type":"ContainerStarted","Data":"e8b520a47b47860406b4e03ea4632f0b28343fb4c8d19789e47efd2f71f35819"} Jul 06 22:25:07.453831 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.453809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvgzk" event={"ID":"78da5cd8-2770-46b9-b0a9-428df8899c61","Type":"ContainerStarted","Data":"f760afb201b0e99111780dd21d2c834c5a99b08ff8d59602c8560d09f9e296fd"} Jul 06 22:25:07.455725 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.455685 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:25:07.455835 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.455803 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-59gps" event={"ID":"9fcf9833-ef22-4dd9-866c-6a65cae2c31d","Type":"ContainerStarted","Data":"8ef7813764c07d1f6ae0c591c8a9c632c2c2f693d1c2ca3c4caa48cafb4ee210"} Jul 06 22:25:07.456279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.456108 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:25:07.462845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.462816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" event={"ID":"f4e232c5-e087-46de-9396-f4808a2003ff","Type":"ContainerStarted","Data":"839fd7baf69bb0e9f36e76fd714ae04003c78186b83e9c6ed022f46f373b3189"} Jul 06 22:25:07.464511 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.464488 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-26bcb" event={"ID":"0668c2b5-b49e-4f1c-96e2-48abe887370b","Type":"ContainerStarted","Data":"d81d20259b72da9a28417d459e46ee2405575bede17fec7c66d02418dfe2139c"} Jul 06 22:25:07.466497 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.466474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" event={"ID":"1298651d-6b05-425c-a95f-6fac0bf05db7","Type":"ContainerStarted","Data":"7f8dc004023b5e262b0ab074a06f3fda2427d1ffdc8612886d515183215a4aca"} Jul 06 22:25:07.466640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.466621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" event={"ID":"1298651d-6b05-425c-a95f-6fac0bf05db7","Type":"ContainerStarted","Data":"d1e30ed62efe5a6a1d997719fc1b662c1ceaec12ff413f356ae544d294b01f5c"} Jul 06 22:25:07.469916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.469897 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-59gps" Jul 06 22:25:07.479632 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.479587 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6hfhp" podStartSLOduration=34.323186526 podStartE2EDuration="40.479576509s" totalImagesPullingTime="6.156389983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.479109271 +0000 UTC m=+74.902995971" watchObservedRunningTime="2026-07-06 22:25:07.479576509 +0000 UTC m=+74.903463208" Jul 06 22:25:07.518248 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.518227 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.531110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.531063 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-j57jt" podStartSLOduration=54.425770838 podStartE2EDuration="1m0.531046195s" totalImagesPullingTime="6.105275357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.503994908 +0000 UTC m=+74.927881609" watchObservedRunningTime="2026-07-06 22:25:07.531046195 +0000 UTC m=+74.954932896" Jul 06 22:25:07.531397 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.531359 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6sz52" podStartSLOduration=39.424791415 podStartE2EDuration="45.531344953s" totalImagesPullingTime="6.106553538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.530128025 +0000 UTC m=+74.954014726" watchObservedRunningTime="2026-07-06 22:25:07.531344953 +0000 UTC m=+74.955231656" Jul 06 22:25:07.552743 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.552593 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rvgzk" podStartSLOduration=17.034800213 podStartE2EDuration="28.552573136s" totalImagesPullingTime="11.517772923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:24:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.551590466 +0000 UTC m=+74.975477164" watchObservedRunningTime="2026-07-06 22:25:07.552573136 +0000 UTC m=+74.976459838" Jul 06 22:25:07.574730 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.574665 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h44z2" podStartSLOduration=47.469645682 podStartE2EDuration="53.574649931s" totalImagesPullingTime="6.105004249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.573703359 +0000 UTC m=+74.997590060" watchObservedRunningTime="2026-07-06 22:25:07.574649931 +0000 UTC m=+74.998536667" Jul 06 22:25:07.596140 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.596092 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-59gps" podStartSLOduration=43.962817975 podStartE2EDuration="52.596073157s" totalImagesPullingTime="8.633255182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.594880283 +0000 UTC m=+75.018766982" watchObservedRunningTime="2026-07-06 22:25:07.596073157 +0000 UTC m=+75.019959860" Jul 06 22:25:07.599996 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.599975 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.610293 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.610255 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-26bcb" podStartSLOduration=66.060970073 podStartE2EDuration="1m13.610241719s" totalImagesPullingTime="7.549271646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:07.609508058 +0000 UTC m=+75.033394759" watchObservedRunningTime="2026-07-06 22:25:07.610241719 +0000 UTC m=+75.034128419" Jul 06 22:25:07.753061 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.753030 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.835551 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.835527 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:07.912561 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:07.912538 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.012620 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.012568 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.185267 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.185239 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.248727 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.248689 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.455146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.455086 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.560465 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.560443 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:08.655205 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:08.655183 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:09.414001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:09.413974 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:09.624081 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:09.624044 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:09.756676 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:09.756646 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:10.828151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:10.828126 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:10.932208 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:10.932185 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:11.406148 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:11.406117 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:11.478698 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:11.478653 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:11.538685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:11.538654 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:12.913801 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:12.913773 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:13.015469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:13.015441 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:13.071227 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:13.071200 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:13.616970 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:13.616947 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:15.566983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.566866 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:15.832903 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.832833 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:15.867559 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.867535 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l"] Jul 06 22:25:15.873621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.873596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:15.876551 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.876531 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8sq5s\"" Jul 06 22:25:15.877747 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.877728 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 22:25:15.877747 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.877744 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:25:15.877903 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.877791 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 22:25:15.887592 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.887572 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l"] Jul 06 22:25:15.907593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.907573 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9m458"] Jul 06 22:25:15.909777 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.909761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:15.912326 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.912298 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:25:15.912420 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.912301 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wsr9r\"" Jul 06 22:25:15.912488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.912474 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:25:15.912567 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.912552 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:25:15.950722 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:15.950687 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.037465 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-tls\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037499 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-sys\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-textfile\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-metrics-client-ca\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2698b3d9-5e14-44a0-b22e-76dcac8858eb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037639 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4q4\" (UniqueName: \"kubernetes.io/projected/4faadc2b-a5c2-4fff-8997-bd95b68669ad-kube-api-access-fb4q4\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-wtmp\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-root\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfdc\" (UniqueName: \"kubernetes.io/projected/2698b3d9-5e14-44a0-b22e-76dcac8858eb-kube-api-access-vdfdc\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.037906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.037825 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.136075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.136010 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.139148 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-tls\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-sys\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-textfile\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-metrics-client-ca\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2698b3d9-5e14-44a0-b22e-76dcac8858eb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.139425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139265 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-sys\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4q4\" (UniqueName: \"kubernetes.io/projected/4faadc2b-a5c2-4fff-8997-bd95b68669ad-kube-api-access-fb4q4\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-wtmp\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139676 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139564 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-textfile\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139786 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-wtmp\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-root\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.139906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139842 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.139906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4faadc2b-a5c2-4fff-8997-bd95b68669ad-root\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.140075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfdc\" (UniqueName: \"kubernetes.io/projected/2698b3d9-5e14-44a0-b22e-76dcac8858eb-kube-api-access-vdfdc\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.140075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.140001 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2698b3d9-5e14-44a0-b22e-76dcac8858eb-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.140075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.139957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.140075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.140056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4faadc2b-a5c2-4fff-8997-bd95b68669ad-metrics-client-ca\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.140075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.140063 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.141754 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.141734 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-tls\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.141850 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.141738 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4faadc2b-a5c2-4fff-8997-bd95b68669ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.142056 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.142039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.142228 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.142209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2698b3d9-5e14-44a0-b22e-76dcac8858eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.147778 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.147759 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfdc\" (UniqueName: \"kubernetes.io/projected/2698b3d9-5e14-44a0-b22e-76dcac8858eb-kube-api-access-vdfdc\") pod \"openshift-state-metrics-54cf96dfcf-5hk8l\" (UID: \"2698b3d9-5e14-44a0-b22e-76dcac8858eb\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.147931 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.147915 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4q4\" (UniqueName: \"kubernetes.io/projected/4faadc2b-a5c2-4fff-8997-bd95b68669ad-kube-api-access-fb4q4\") pod \"node-exporter-9m458\" (UID: \"4faadc2b-a5c2-4fff-8997-bd95b68669ad\") " pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.182501 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.182475 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" Jul 06 22:25:16.218165 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.218139 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9m458" Jul 06 22:25:16.234757 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:16.234727 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faadc2b_a5c2_4fff_8997_bd95b68669ad.slice/crio-b38a3ee38648b11e508518f00a14e0553d11fb2229adbfb40bd1b8380f1de3cd WatchSource:0}: Error finding container b38a3ee38648b11e508518f00a14e0553d11fb2229adbfb40bd1b8380f1de3cd: Status 404 returned error can't find the container with id b38a3ee38648b11e508518f00a14e0553d11fb2229adbfb40bd1b8380f1de3cd Jul 06 22:25:16.239257 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.239213 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.312144 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.312068 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l"] Jul 06 22:25:16.314076 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:16.314044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2698b3d9_5e14_44a0_b22e_76dcac8858eb.slice/crio-5f78b422f9373eb21024c81e329f1cb9593ee051da3f805007e5aa12b622d2d9 WatchSource:0}: Error finding container 5f78b422f9373eb21024c81e329f1cb9593ee051da3f805007e5aa12b622d2d9: Status 404 returned error can't find the container with id 5f78b422f9373eb21024c81e329f1cb9593ee051da3f805007e5aa12b622d2d9 Jul 06 22:25:16.314946 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.314911 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.382502 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.382470 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.498246 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.498211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m458" event={"ID":"4faadc2b-a5c2-4fff-8997-bd95b68669ad","Type":"ContainerStarted","Data":"b38a3ee38648b11e508518f00a14e0553d11fb2229adbfb40bd1b8380f1de3cd"} Jul 06 22:25:16.499968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.499943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" event={"ID":"2698b3d9-5e14-44a0-b22e-76dcac8858eb","Type":"ContainerStarted","Data":"8b760602790c6efd74ab8fdf0bb57a10f43a248ebced524fcd763a450e9c4b6f"} Jul 06 22:25:16.500084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.499989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" event={"ID":"2698b3d9-5e14-44a0-b22e-76dcac8858eb","Type":"ContainerStarted","Data":"a306c45e8f0017a1d297805209d03255fbd891822fe0a071b1c0de7c4442a182"} Jul 06 22:25:16.500084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.500010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" event={"ID":"2698b3d9-5e14-44a0-b22e-76dcac8858eb","Type":"ContainerStarted","Data":"5f78b422f9373eb21024c81e329f1cb9593ee051da3f805007e5aa12b622d2d9"} Jul 06 22:25:16.641446 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.641380 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.742415 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.742388 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:16.852451 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:16.852348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:17.002013 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.001778 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:17.004242 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.004220 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:25:17.007063 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.007039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.010639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.010614 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 22:25:17.010894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.010877 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 22:25:17.010992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.010941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 22:25:17.011080 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011068 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 22:25:17.011152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011107 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 22:25:17.011209 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011164 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 22:25:17.011384 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011367 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 22:25:17.011462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011373 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pg7qq\"" Jul 06 22:25:17.011462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 22:25:17.011617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.011601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 22:25:17.027604 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.027170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:25:17.048265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048540 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048540 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048540 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048689 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048689 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb4xh\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048689 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048689 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048913 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.048913 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.048764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.150494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.149932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.150494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.149985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.150494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.150011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.150494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.150045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.150494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.150430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.150986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb4xh\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:25:17.151131 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:25:17.151198 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls podName:d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c nodeName:}" failed. No retries permitted until 2026-07-06 22:25:17.651176987 +0000 UTC m=+85.075063683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c") : secret "alertmanager-main-tls" not found Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151273 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.151482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.151350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.153255 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.152370 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.154676 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.154651 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.155139 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.155114 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.156075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.156052 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.157135 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.157110 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.159418 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.159368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.159561 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.159536 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.159680 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.159628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.160100 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.160061 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.160423 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.160403 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.164461 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.164395 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb4xh\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.295328 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.295246 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:17.472919 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.472882 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hfhp" Jul 06 22:25:17.658075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.657967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.660931 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.660909 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.850376 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.850344 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79877d8cf6-4cpc7"] Jul 06 22:25:17.852974 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.852948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.855521 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.855498 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fkbsv4mc95o5c\"" Jul 06 22:25:17.855521 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.855508 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 22:25:17.855693 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.855621 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 22:25:17.855802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.855783 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 22:25:17.855860 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.855837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 22:25:17.856320 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.856305 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 22:25:17.856422 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.856407 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pg8cs\"" Jul 06 22:25:17.859684 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.859810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859747 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.859810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47cdccf3-50ba-4d36-b313-df9fc7173ed8-metrics-client-ca\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.860037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf9dl\" (UniqueName: \"kubernetes.io/projected/47cdccf3-50ba-4d36-b313-df9fc7173ed8-kube-api-access-mf9dl\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.860037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.860037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-grpc-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.860037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.859984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.860037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.860013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.867656 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.867637 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79877d8cf6-4cpc7"] Jul 06 22:25:17.919616 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.919562 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:25:17.960766 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.960739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.960879 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.960783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-grpc-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.960879 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.960819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.960991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.960936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.961046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.960992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.961100 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.961046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.961151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.961097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47cdccf3-50ba-4d36-b313-df9fc7173ed8-metrics-client-ca\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.961151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.961125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf9dl\" (UniqueName: \"kubernetes.io/projected/47cdccf3-50ba-4d36-b313-df9fc7173ed8-kube-api-access-mf9dl\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.962161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.962112 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47cdccf3-50ba-4d36-b313-df9fc7173ed8-metrics-client-ca\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.963527 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.963484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.963764 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.963741 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.963827 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.963749 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-grpc-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.963997 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.963970 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.963997 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.963988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-tls\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.964168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.964123 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47cdccf3-50ba-4d36-b313-df9fc7173ed8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:17.969834 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:17.969810 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf9dl\" (UniqueName: \"kubernetes.io/projected/47cdccf3-50ba-4d36-b313-df9fc7173ed8-kube-api-access-mf9dl\") pod \"thanos-querier-79877d8cf6-4cpc7\" (UID: \"47cdccf3-50ba-4d36-b313-df9fc7173ed8\") " pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:18.055745 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.055682 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:25:18.058292 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:18.058265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04bd861_cdfa_4fb3_a69e_8fe1842b3c0c.slice/crio-7f0fbf5ab69ea2e91d8e7c4cecdc1562dd8e8b0a24244cba7dfed9651fffd476 WatchSource:0}: Error finding container 7f0fbf5ab69ea2e91d8e7c4cecdc1562dd8e8b0a24244cba7dfed9651fffd476: Status 404 returned error can't find the container with id 7f0fbf5ab69ea2e91d8e7c4cecdc1562dd8e8b0a24244cba7dfed9651fffd476 Jul 06 22:25:18.162945 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.162926 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:18.316905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.316871 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79877d8cf6-4cpc7"] Jul 06 22:25:18.320165 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:18.320131 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cdccf3_50ba_4d36_b313_df9fc7173ed8.slice/crio-f73836826e3b3978f8486d866d7949727ae87366a2b44536042153f82dc53b2c WatchSource:0}: Error finding container f73836826e3b3978f8486d866d7949727ae87366a2b44536042153f82dc53b2c: Status 404 returned error can't find the container with id f73836826e3b3978f8486d866d7949727ae87366a2b44536042153f82dc53b2c Jul 06 22:25:18.525155 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.525122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"7f0fbf5ab69ea2e91d8e7c4cecdc1562dd8e8b0a24244cba7dfed9651fffd476"} Jul 06 22:25:18.526675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.526649 2568 generic.go:356] "Generic (PLEG): container finished" podID="4faadc2b-a5c2-4fff-8997-bd95b68669ad" containerID="e6695e36437b9d82b38265d3700af348bf74409a8fb8a4f837b5998e3e81e1d3" exitCode=0 Jul 06 22:25:18.526811 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.526732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m458" event={"ID":"4faadc2b-a5c2-4fff-8997-bd95b68669ad","Type":"ContainerDied","Data":"e6695e36437b9d82b38265d3700af348bf74409a8fb8a4f837b5998e3e81e1d3"} Jul 06 22:25:18.528884 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.528864 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" event={"ID":"2698b3d9-5e14-44a0-b22e-76dcac8858eb","Type":"ContainerStarted","Data":"61faab4736e42ec194b4bda56af27b0d19cb89f126f4cdca5e527f4079e5d79c"} Jul 06 22:25:18.530218 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.530152 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"f73836826e3b3978f8486d866d7949727ae87366a2b44536042153f82dc53b2c"} Jul 06 22:25:18.564626 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.564588 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5hk8l" podStartSLOduration=2.356090772 podStartE2EDuration="3.564573495s" totalImagesPullingTime="1.208482723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:18.563984203 +0000 UTC m=+85.987870903" watchObservedRunningTime="2026-07-06 22:25:18.564573495 +0000 UTC m=+85.988460194" Jul 06 22:25:18.781264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.781190 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:18.879564 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:18.879533 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:19.024341 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.024310 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:19.101167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.101087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:19.253102 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.253065 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:19.536701 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.536670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m458" event={"ID":"4faadc2b-a5c2-4fff-8997-bd95b68669ad","Type":"ContainerStarted","Data":"4995675bfd64882ff73a4005ee5bb8ef64df8c5dccebfde92b45c13fd6a971db"} Jul 06 22:25:19.536854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.536750 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9m458" event={"ID":"4faadc2b-a5c2-4fff-8997-bd95b68669ad","Type":"ContainerStarted","Data":"3344808bd0308b908103ac6354dd1a0759b6a50612862ae71a715c4286e8dd24"} Jul 06 22:25:19.538156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.538136 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f" exitCode=0 Jul 06 22:25:19.538273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.538188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f"} Jul 06 22:25:19.556872 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.556830 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9m458" podStartSLOduration=3.105441121 podStartE2EDuration="4.556816953s" totalImagesPullingTime="1.38578215s" totalInitContainerRuntime="65.593682ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:19.556013299 +0000 UTC m=+86.979899999" watchObservedRunningTime="2026-07-06 22:25:19.556816953 +0000 UTC m=+86.980703673" Jul 06 22:25:19.894824 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.894786 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:19.949731 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:19.949686 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:20.275503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.275476 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-764cd5fbfc-j9jf9"] Jul 06 22:25:20.278124 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.278100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281729 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281729 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281788 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6mxk8\"" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281794 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281832 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 22:25:20.281944 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.281864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f3ivj5f2iehp2\"" Jul 06 22:25:20.289463 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.289443 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-764cd5fbfc-j9jf9"] Jul 06 22:25:20.382822 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.382791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-client-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.382980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.382832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hck7b\" (UniqueName: \"kubernetes.io/projected/f5635750-f0b7-46d2-8e40-fc0843cd3f31-kube-api-access-hck7b\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.382980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.382923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-metrics-server-audit-profiles\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.382980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.382945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-client-certs\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.383161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.383026 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.383161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.383067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-tls\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.383161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.383118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5635750-f0b7-46d2-8e40-fc0843cd3f31-audit-log\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484207 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-metrics-server-audit-profiles\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-client-certs\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484265 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484294 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-tls\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5635750-f0b7-46d2-8e40-fc0843cd3f31-audit-log\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484563 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-client-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.484563 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.484405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hck7b\" (UniqueName: \"kubernetes.io/projected/f5635750-f0b7-46d2-8e40-fc0843cd3f31-kube-api-access-hck7b\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.485059 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.485031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5635750-f0b7-46d2-8e40-fc0843cd3f31-audit-log\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.485172 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.485138 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.485292 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.485273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5635750-f0b7-46d2-8e40-fc0843cd3f31-metrics-server-audit-profiles\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.487241 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.487177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-client-ca-bundle\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.487357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.487299 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-client-certs\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.487357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.487331 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5635750-f0b7-46d2-8e40-fc0843cd3f31-secret-metrics-server-tls\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.495894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.495870 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hck7b\" (UniqueName: \"kubernetes.io/projected/f5635750-f0b7-46d2-8e40-fc0843cd3f31-kube-api-access-hck7b\") pod \"metrics-server-764cd5fbfc-j9jf9\" (UID: \"f5635750-f0b7-46d2-8e40-fc0843cd3f31\") " pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.589387 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.589292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:20.592915 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.592887 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:20.662426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.662389 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:20.726372 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.726348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:20.824502 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:20.824477 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-764cd5fbfc-j9jf9"] Jul 06 22:25:20.829030 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:20.829004 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5635750_f0b7_46d2_8e40_fc0843cd3f31.slice/crio-19deeb7df00e08e3690f2e9505a3377198f7355e5f2379494014cda99b07a9f6 WatchSource:0}: Error finding container 19deeb7df00e08e3690f2e9505a3377198f7355e5f2379494014cda99b07a9f6: Status 404 returned error can't find the container with id 19deeb7df00e08e3690f2e9505a3377198f7355e5f2379494014cda99b07a9f6 Jul 06 22:25:21.549969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:21.549932 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"1814ac05c1f24cc8cb493c1e557c63567ef35bee13fca3a0b163fa4954dc156c"} Jul 06 22:25:21.550383 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:21.550044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"6479c6a1b0087e3f7cab74470e5855bf454d5d4bfc2a55cef9dda499493c9dd2"} Jul 06 22:25:21.550383 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:21.550093 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"eb45d58ba50d312f890be511e666ed16219ccad8e6b7705386620c62ee1b8f37"} Jul 06 22:25:21.551530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:21.551504 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" event={"ID":"f5635750-f0b7-46d2-8e40-fc0843cd3f31","Type":"ContainerStarted","Data":"19deeb7df00e08e3690f2e9505a3377198f7355e5f2379494014cda99b07a9f6"} Jul 06 22:25:22.113891 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:22.113860 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:23.433523 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.433476 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:23.438049 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.438028 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:25:23.534591 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.534567 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:23.563110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.562972 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"adbf5f2d9b645f83cefa276c98e48470e3639d9d17e16dc2765218233232637f"} Jul 06 22:25:23.563110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.563037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"35cdf13cbb97c63848f7311e35be8270c32f2b3b46f2694ea28c9640fb268868"} Jul 06 22:25:23.563110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.563076 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" event={"ID":"47cdccf3-50ba-4d36-b313-df9fc7173ed8","Type":"ContainerStarted","Data":"f0274b021844061427198c0c663db7bbc2e24a023e35161cab63aca345294bff"} Jul 06 22:25:23.563343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.563329 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:23.564571 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.564537 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" event={"ID":"f5635750-f0b7-46d2-8e40-fc0843cd3f31","Type":"ContainerStarted","Data":"436d3dfcd4d5dc151e9f3657d4b8e5c0ca61259027608a241432b5a421a12d84"} Jul 06 22:25:23.567764 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d"} Jul 06 22:25:23.567851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567794 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019"} Jul 06 22:25:23.567851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567827 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711"} Jul 06 22:25:23.567956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025"} Jul 06 22:25:23.567956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7"} Jul 06 22:25:23.567956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.567918 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerStarted","Data":"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2"} Jul 06 22:25:23.586870 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.586832 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" podStartSLOduration=2.505805613 podStartE2EDuration="6.58681765s" totalImagesPullingTime="4.081012037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:23.585111382 +0000 UTC m=+91.008998085" watchObservedRunningTime="2026-07-06 22:25:23.58681765 +0000 UTC m=+91.010704350" Jul 06 22:25:23.612447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.612406 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.304260931 podStartE2EDuration="7.612393707s" totalImagesPullingTime="4.289358613s" totalInitContainerRuntime="18.774163ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:23.609572802 +0000 UTC m=+91.033459501" watchObservedRunningTime="2026-07-06 22:25:23.612393707 +0000 UTC m=+91.036280448" Jul 06 22:25:23.614220 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.614202 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:23.627399 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.627355 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" podStartSLOduration=1.87822091 podStartE2EDuration="3.627341629s" totalImagesPullingTime="1.749120719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:23.626393303 +0000 UTC m=+91.050280003" watchObservedRunningTime="2026-07-06 22:25:23.627341629 +0000 UTC m=+91.051228358" Jul 06 22:25:23.739423 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:23.739356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:27.231609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.231581 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:25:27.234448 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.234431 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.238010 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.237980 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 22:25:27.238136 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 22:25:27.238136 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238116 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 22:25:27.238136 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238126 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 22:25:27.238317 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238273 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 22:25:27.238317 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238283 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hcvcf\"" Jul 06 22:25:27.238398 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238335 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 22:25:27.238398 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.238357 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 22:25:27.242583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.242563 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 22:25:27.246884 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.246864 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:25:27.337991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.337966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.337994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.338013 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbmz\" (UniqueName: \"kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.338037 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338198 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.338128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338198 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.338154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.338198 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.338191 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439129 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439195 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.439264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbmz\" (UniqueName: \"kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.440001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.440111 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.439976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.440167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.440125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.440167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.440141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.441641 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.441617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.441765 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.441746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.447322 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.447301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbmz\" (UniqueName: \"kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz\") pod \"console-57c484bd65-g2mtm\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.545065 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.545044 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:27.678936 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.678910 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:25:27.681376 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:25:27.681352 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91674630_8306_448f_9047_9f5d85fc427d.slice/crio-fa712b68f8f001fd5680037c20a194c6aa7d89366d1b9cf0873dc085ccbaeb55 WatchSource:0}: Error finding container fa712b68f8f001fd5680037c20a194c6aa7d89366d1b9cf0873dc085ccbaeb55: Status 404 returned error can't find the container with id fa712b68f8f001fd5680037c20a194c6aa7d89366d1b9cf0873dc085ccbaeb55 Jul 06 22:25:27.894404 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.894334 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:27.974436 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:27.974412 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:28.593782 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:28.593744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c484bd65-g2mtm" event={"ID":"91674630-8306-448f-9047-9f5d85fc427d","Type":"ContainerStarted","Data":"fa712b68f8f001fd5680037c20a194c6aa7d89366d1b9cf0873dc085ccbaeb55"} Jul 06 22:25:28.914571 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:28.914496 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:28.980451 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:28.980421 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:29.579968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:29.579940 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79877d8cf6-4cpc7" Jul 06 22:25:30.380937 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.380901 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:30.401845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.401818 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7dvvr" Jul 06 22:25:30.458449 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.458421 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:30.534832 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.534799 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:25:30.713914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.713838 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:30.813802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:30.813777 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:31.608202 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:31.608169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c484bd65-g2mtm" event={"ID":"91674630-8306-448f-9047-9f5d85fc427d","Type":"ContainerStarted","Data":"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591"} Jul 06 22:25:31.630005 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:31.629958 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57c484bd65-g2mtm" podStartSLOduration=1.441379983 podStartE2EDuration="4.629942439s" totalImagesPullingTime="3.188562456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:25:31.628169619 +0000 UTC m=+99.052056321" watchObservedRunningTime="2026-07-06 22:25:31.629942439 +0000 UTC m=+99.053829140" Jul 06 22:25:32.128293 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:32.128263 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:32.192334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:32.192310 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:34.454374 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:34.454343 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:37.545937 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.545906 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:37.546313 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.545959 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:37.550756 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.550705 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:37.635388 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.635369 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:25:37.928547 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.928471 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:37.983648 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:37.983618 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.238422 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.238341 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.337173 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.337141 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.458613 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.458589 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.558611 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.558584 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.666916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.666876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:38.767126 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:38.767098 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:39.477772 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:39.477741 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:39.534676 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:39.534620 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:40.589403 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:40.589370 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:40.589772 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:40.589426 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:25:53.457023 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:53.456991 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:53.507130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:53.507102 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:55.554912 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.554876 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" podUID="cf65c38c-84a7-4579-9bba-80c08192be90" containerName="registry" containerID="cri-o://f1f904317990b96cc47806c56888eb4c169a8f8beb342517853d9927d90a6fa1" gracePeriod=30 Jul 06 22:25:55.707354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.707315 2568 generic.go:356] "Generic (PLEG): container finished" podID="cf65c38c-84a7-4579-9bba-80c08192be90" containerID="f1f904317990b96cc47806c56888eb4c169a8f8beb342517853d9927d90a6fa1" exitCode=0 Jul 06 22:25:55.707484 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.707388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" event={"ID":"cf65c38c-84a7-4579-9bba-80c08192be90","Type":"ContainerDied","Data":"f1f904317990b96cc47806c56888eb4c169a8f8beb342517853d9927d90a6fa1"} Jul 06 22:25:55.791269 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.791249 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:25:55.861968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.861911 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.861968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.861952 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862112 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.861970 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862112 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.861991 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862112 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862031 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl2gn\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862112 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862079 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862151 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862179 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration\") pod \"cf65c38c-84a7-4579-9bba-80c08192be90\" (UID: \"cf65c38c-84a7-4579-9bba-80c08192be90\") " Jul 06 22:25:55.862395 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862355 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:25:55.862489 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862471 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-trusted-ca\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.862569 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.862461 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:25:55.864593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.864564 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:55.864767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.864622 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:25:55.864767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.864631 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:55.864920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.864893 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn" (OuterVolumeSpecName: "kube-api-access-kl2gn") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "kube-api-access-kl2gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:25:55.865019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.864998 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:25:55.870227 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.870206 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf65c38c-84a7-4579-9bba-80c08192be90" (UID: "cf65c38c-84a7-4579-9bba-80c08192be90"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:25:55.963658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963624 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-installation-pull-secrets\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963656 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf65c38c-84a7-4579-9bba-80c08192be90-image-registry-private-configuration\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963671 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf65c38c-84a7-4579-9bba-80c08192be90-ca-trust-extracted\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963685 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-bound-sa-token\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963698 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf65c38c-84a7-4579-9bba-80c08192be90-registry-certificates\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963734 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl2gn\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-kube-api-access-kl2gn\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:55.963826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:55.963750 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf65c38c-84a7-4579-9bba-80c08192be90-registry-tls\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:25:56.600934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.600893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:25:56.712870 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.712841 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" event={"ID":"cf65c38c-84a7-4579-9bba-80c08192be90","Type":"ContainerDied","Data":"21fee7a707e1858b84fcf9d5cd9c3a6a46df7ddfa6afc7630743bf0bf0ed973b"} Jul 06 22:25:56.712870 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.712858 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c798ffd-vgtll" Jul 06 22:25:56.713057 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.712929 2568 scope.go:117] "RemoveContainer" containerID="f1f904317990b96cc47806c56888eb4c169a8f8beb342517853d9927d90a6fa1" Jul 06 22:25:56.736559 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.736534 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:25:56.738739 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:56.738700 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c5c798ffd-vgtll"] Jul 06 22:25:57.025349 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:57.025321 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf65c38c-84a7-4579-9bba-80c08192be90" path="/var/lib/kubelet/pods/cf65c38c-84a7-4579-9bba-80c08192be90/volumes" Jul 06 22:25:58.724166 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:58.724139 2568 generic.go:356] "Generic (PLEG): container finished" podID="dfa9be99-701e-497c-bbfc-0f33ffa9370d" containerID="1b9d06271da6bfb706cee7f1615184bef45df74242f5e8a2ff663cef442a8df6" exitCode=0 Jul 06 22:25:58.724459 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:58.724213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" event={"ID":"dfa9be99-701e-497c-bbfc-0f33ffa9370d","Type":"ContainerDied","Data":"1b9d06271da6bfb706cee7f1615184bef45df74242f5e8a2ff663cef442a8df6"} Jul 06 22:25:58.724530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:58.724514 2568 scope.go:117] "RemoveContainer" containerID="1b9d06271da6bfb706cee7f1615184bef45df74242f5e8a2ff663cef442a8df6" Jul 06 22:25:59.731026 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:25:59.730994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mktxb" event={"ID":"dfa9be99-701e-497c-bbfc-0f33ffa9370d","Type":"ContainerStarted","Data":"cf8fdad87cc311ccaeafb5d1be6224fcfb3a84548584793d632ee5c264182c53"} Jul 06 22:26:00.595347 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:00.595318 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:26:00.599324 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:00.599296 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-764cd5fbfc-j9jf9" Jul 06 22:26:03.749051 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:03.749018 2568 generic.go:356] "Generic (PLEG): container finished" podID="703017f9-2541-4f1a-ba91-e86a14a415f9" containerID="a3de0f5f56a769dffcaf1397d196c705bcb5764a9210acc70af9f443962441b7" exitCode=0 Jul 06 22:26:03.749536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:03.749098 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" event={"ID":"703017f9-2541-4f1a-ba91-e86a14a415f9","Type":"ContainerDied","Data":"a3de0f5f56a769dffcaf1397d196c705bcb5764a9210acc70af9f443962441b7"} Jul 06 22:26:03.749536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:03.749458 2568 scope.go:117] "RemoveContainer" containerID="a3de0f5f56a769dffcaf1397d196c705bcb5764a9210acc70af9f443962441b7" Jul 06 22:26:04.755417 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:04.755380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-vjnv2" event={"ID":"703017f9-2541-4f1a-ba91-e86a14a415f9","Type":"ContainerStarted","Data":"0261f3e4a03ffca7ba2f4ae07d54ce7cb7d13a0a57be01a588528e7e4ff056e7"} Jul 06 22:26:08.773997 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:08.773961 2568 generic.go:356] "Generic (PLEG): container finished" podID="50b581c5-2f6a-4705-9790-a309edac9cbe" containerID="18c07eba70bf6a94b4437a3ee1fd65b91f5e58a9e115b4e915729d19cc945f5c" exitCode=0 Jul 06 22:26:08.774365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:08.774033 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" event={"ID":"50b581c5-2f6a-4705-9790-a309edac9cbe","Type":"ContainerDied","Data":"18c07eba70bf6a94b4437a3ee1fd65b91f5e58a9e115b4e915729d19cc945f5c"} Jul 06 22:26:08.774365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:08.774342 2568 scope.go:117] "RemoveContainer" containerID="18c07eba70bf6a94b4437a3ee1fd65b91f5e58a9e115b4e915729d19cc945f5c" Jul 06 22:26:09.780323 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:09.780293 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x9v6b" event={"ID":"50b581c5-2f6a-4705-9790-a309edac9cbe","Type":"ContainerStarted","Data":"911e7215d606c70115021fd2396625582f841c6de1637e12685f56601c6c6bb7"} Jul 06 22:26:35.034263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:35.034223 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:35.335697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:35.335621 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:36.111008 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.110977 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:36.111426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111287 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="alertmanager" containerID="cri-o://322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" gracePeriod=120 Jul 06 22:26:36.111426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111361 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-metric" containerID="cri-o://0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" gracePeriod=120 Jul 06 22:26:36.111426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111387 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-web" containerID="cri-o://c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" gracePeriod=120 Jul 06 22:26:36.111595 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111402 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="config-reloader" containerID="cri-o://3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" gracePeriod=120 Jul 06 22:26:36.111595 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111436 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy" containerID="cri-o://ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" gracePeriod=120 Jul 06 22:26:36.111595 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.111458 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="prom-label-proxy" containerID="cri-o://ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" gracePeriod=120 Jul 06 22:26:36.897017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.896989 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" exitCode=0 Jul 06 22:26:36.897017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897015 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" exitCode=0 Jul 06 22:26:36.897017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897022 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" exitCode=0 Jul 06 22:26:36.897235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897028 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" exitCode=0 Jul 06 22:26:36.897235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897060 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d"} Jul 06 22:26:36.897235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711"} Jul 06 22:26:36.897235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7"} Jul 06 22:26:36.897235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:36.897178 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2"} Jul 06 22:26:37.346259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.346237 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:37.366564 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366538 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366568 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366593 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366653 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366688 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366755 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366810 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb4xh\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366865 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366906 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.366969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366934 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.367322 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366986 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out\") pod \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\" (UID: \"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c\") " Jul 06 22:26:37.367894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366932 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:26:37.367894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.366995 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:26:37.368164 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.367004 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:26:37.369302 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.369254 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.369851 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.369937 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.370062 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume" (OuterVolumeSpecName: "config-volume") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.370047 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.370182 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.369890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.370272 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out" (OuterVolumeSpecName: "config-out") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:26:37.371367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.371330 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh" (OuterVolumeSpecName: "kube-api-access-mb4xh") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "kube-api-access-mb4xh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:26:37.376545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.376520 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.384808 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.384781 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config" (OuterVolumeSpecName: "web-config") pod "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" (UID: "d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:26:37.468346 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468284 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-volume\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468346 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468309 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-main-tls\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468346 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468323 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468346 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468335 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-tls-assets\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468349 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb4xh\" (UniqueName: \"kubernetes.io/projected/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-kube-api-access-mb4xh\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468361 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-cluster-tls-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468372 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-web-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468384 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468397 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-config-out\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468409 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468422 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-metrics-client-ca\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468435 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.468553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.468448 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c-alertmanager-main-db\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:26:37.905192 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905154 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" exitCode=0 Jul 06 22:26:37.905192 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905184 2568 generic.go:356] "Generic (PLEG): container finished" podID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerID="c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" exitCode=0 Jul 06 22:26:37.905424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905244 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:37.905424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905240 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019"} Jul 06 22:26:37.905424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905339 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025"} Jul 06 22:26:37.905424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905380 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c","Type":"ContainerDied","Data":"7f0fbf5ab69ea2e91d8e7c4cecdc1562dd8e8b0a24244cba7dfed9651fffd476"} Jul 06 22:26:37.905424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.905410 2568 scope.go:117] "RemoveContainer" containerID="ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" Jul 06 22:26:37.917419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.916658 2568 scope.go:117] "RemoveContainer" containerID="0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" Jul 06 22:26:37.925353 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.925333 2568 scope.go:117] "RemoveContainer" containerID="ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" Jul 06 22:26:37.932587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.932570 2568 scope.go:117] "RemoveContainer" containerID="c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" Jul 06 22:26:37.935935 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.935914 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:37.938983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.938962 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:37.940434 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.940413 2568 scope.go:117] "RemoveContainer" containerID="3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" Jul 06 22:26:37.947454 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.947440 2568 scope.go:117] "RemoveContainer" containerID="322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" Jul 06 22:26:37.956336 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.955735 2568 scope.go:117] "RemoveContainer" containerID="88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f" Jul 06 22:26:37.963761 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.963743 2568 scope.go:117] "RemoveContainer" containerID="ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" Jul 06 22:26:37.964005 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.963988 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d\": container with ID starting with ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d not found: ID does not exist" containerID="ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" Jul 06 22:26:37.964067 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964012 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d"} err="failed to get container status \"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d\": rpc error: code = NotFound desc = could not find container \"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d\": container with ID starting with ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d not found: ID does not exist" Jul 06 22:26:37.964067 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964042 2568 scope.go:117] "RemoveContainer" containerID="0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" Jul 06 22:26:37.964289 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.964274 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019\": container with ID starting with 0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019 not found: ID does not exist" containerID="0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" Jul 06 22:26:37.964335 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964291 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019"} err="failed to get container status \"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019\": rpc error: code = NotFound desc = could not find container \"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019\": container with ID starting with 0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019 not found: ID does not exist" Jul 06 22:26:37.964335 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964312 2568 scope.go:117] "RemoveContainer" containerID="ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" Jul 06 22:26:37.964544 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.964528 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711\": container with ID starting with ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711 not found: ID does not exist" containerID="ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" Jul 06 22:26:37.964584 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964550 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711"} err="failed to get container status \"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711\": rpc error: code = NotFound desc = could not find container \"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711\": container with ID starting with ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711 not found: ID does not exist" Jul 06 22:26:37.964584 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964565 2568 scope.go:117] "RemoveContainer" containerID="c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" Jul 06 22:26:37.964898 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.964790 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025\": container with ID starting with c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025 not found: ID does not exist" containerID="c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" Jul 06 22:26:37.964898 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964808 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025"} err="failed to get container status \"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025\": rpc error: code = NotFound desc = could not find container \"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025\": container with ID starting with c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025 not found: ID does not exist" Jul 06 22:26:37.964898 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.964828 2568 scope.go:117] "RemoveContainer" containerID="3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" Jul 06 22:26:37.965464 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.965426 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7\": container with ID starting with 3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7 not found: ID does not exist" containerID="3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" Jul 06 22:26:37.965547 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.965461 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7"} err="failed to get container status \"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7\": rpc error: code = NotFound desc = could not find container \"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7\": container with ID starting with 3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7 not found: ID does not exist" Jul 06 22:26:37.965547 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.965483 2568 scope.go:117] "RemoveContainer" containerID="322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" Jul 06 22:26:37.965757 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.965734 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2\": container with ID starting with 322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2 not found: ID does not exist" containerID="322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" Jul 06 22:26:37.965817 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.965762 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2"} err="failed to get container status \"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2\": rpc error: code = NotFound desc = could not find container \"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2\": container with ID starting with 322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2 not found: ID does not exist" Jul 06 22:26:37.965817 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.965782 2568 scope.go:117] "RemoveContainer" containerID="88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f" Jul 06 22:26:37.966035 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:26:37.966018 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f\": container with ID starting with 88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f not found: ID does not exist" containerID="88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f" Jul 06 22:26:37.966078 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966051 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f"} err="failed to get container status \"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f\": rpc error: code = NotFound desc = could not find container \"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f\": container with ID starting with 88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f not found: ID does not exist" Jul 06 22:26:37.966078 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966068 2568 scope.go:117] "RemoveContainer" containerID="ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d" Jul 06 22:26:37.966262 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966242 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d"} err="failed to get container status \"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d\": rpc error: code = NotFound desc = could not find container \"ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d\": container with ID starting with ca39d68cd3bad539bfcb7d54b70cdded14b68ec87cb9538119f124a90fef591d not found: ID does not exist" Jul 06 22:26:37.966325 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966262 2568 scope.go:117] "RemoveContainer" containerID="0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019" Jul 06 22:26:37.966528 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966508 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019"} err="failed to get container status \"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019\": rpc error: code = NotFound desc = could not find container \"0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019\": container with ID starting with 0b395eb2f2266582e52c11158a5c8cb185f696f3c110a5fa64a10c2f9ff24019 not found: ID does not exist" Jul 06 22:26:37.966528 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966527 2568 scope.go:117] "RemoveContainer" containerID="ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711" Jul 06 22:26:37.966802 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966778 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711"} err="failed to get container status \"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711\": rpc error: code = NotFound desc = could not find container \"ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711\": container with ID starting with ad3b586f7d195af0c13317f14c112764148607adcdf57d9b27b8945fb5552711 not found: ID does not exist" Jul 06 22:26:37.966861 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966803 2568 scope.go:117] "RemoveContainer" containerID="c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025" Jul 06 22:26:37.967020 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.966999 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025"} err="failed to get container status \"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025\": rpc error: code = NotFound desc = could not find container \"c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025\": container with ID starting with c29716aadaf36d7ec744b36bce659c491b4d98134bfe0872073a9b3cb462b025 not found: ID does not exist" Jul 06 22:26:37.967069 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967023 2568 scope.go:117] "RemoveContainer" containerID="3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7" Jul 06 22:26:37.967130 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967115 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:37.967250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967230 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7"} err="failed to get container status \"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7\": rpc error: code = NotFound desc = could not find container \"3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7\": container with ID starting with 3ac1bebc972d0cc3ffc33f546c2be4582f8aa34abab99dcad712f86ad626f4f7 not found: ID does not exist" Jul 06 22:26:37.967294 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967253 2568 scope.go:117] "RemoveContainer" containerID="322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2" Jul 06 22:26:37.967449 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967428 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2"} err="failed to get container status \"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2\": rpc error: code = NotFound desc = could not find container \"322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2\": container with ID starting with 322866735eec4d73621e7c068179f4f222d89e3679b50be3e5f240707b875aa2 not found: ID does not exist" Jul 06 22:26:37.967449 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967448 2568 scope.go:117] "RemoveContainer" containerID="88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967486 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-web" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967501 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-web" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967508 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="prom-label-proxy" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967513 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="prom-label-proxy" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967524 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="init-config-reloader" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967530 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="init-config-reloader" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967537 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf65c38c-84a7-4579-9bba-80c08192be90" containerName="registry" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967545 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf65c38c-84a7-4579-9bba-80c08192be90" containerName="registry" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967555 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-metric" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967560 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-metric" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967574 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="alertmanager" Jul 06 22:26:37.967581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967582 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="alertmanager" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967590 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967595 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967603 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="config-reloader" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967608 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="config-reloader" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967654 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f"} err="failed to get container status \"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f\": rpc error: code = NotFound desc = could not find container \"88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f\": container with ID starting with 88a014589565e98afa8ac4ab697fd172b8e6cdba94ce9d19d30fe796956a8d0f not found: ID does not exist" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967663 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="alertmanager" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967681 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="config-reloader" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967689 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf65c38c-84a7-4579-9bba-80c08192be90" containerName="registry" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967697 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-web" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967706 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy-metric" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967740 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="prom-label-proxy" Jul 06 22:26:37.968044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.967745 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" containerName="kube-rbac-proxy" Jul 06 22:26:37.972844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.972828 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:37.975690 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.975671 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 22:26:37.975804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.975722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 22:26:37.975804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.975701 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 22:26:37.975993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.975980 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pg7qq\"" Jul 06 22:26:37.975993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.975987 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 22:26:37.976088 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.976010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 22:26:37.976088 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.976063 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 22:26:37.976426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.976409 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 22:26:37.976480 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.976465 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 22:26:37.981663 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.981646 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 22:26:37.986669 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:37.986649 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:38.072341 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072341 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072346 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tclg9\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-kube-api-access-tclg9\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072593 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.072675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.072666 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173257 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173257 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173228 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173257 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tclg9\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-kube-api-access-tclg9\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173800 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173800 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173800 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.173800 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.173747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.174328 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.174261 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.174582 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.174525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.174700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.174678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5daca71-3a59-47e5-982e-88069c44e2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.176364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.176316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.176364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.176347 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.176700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.176667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.176840 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.176674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.176994 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.176966 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.177316 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.177296 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.177474 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.177456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5daca71-3a59-47e5-982e-88069c44e2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.177926 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.177903 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.178015 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.177997 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5daca71-3a59-47e5-982e-88069c44e2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.181105 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.181079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tclg9\" (UniqueName: \"kubernetes.io/projected/f5daca71-3a59-47e5-982e-88069c44e2d8-kube-api-access-tclg9\") pod \"alertmanager-main-0\" (UID: \"f5daca71-3a59-47e5-982e-88069c44e2d8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.282297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.282273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 22:26:38.414513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.414488 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 22:26:38.416639 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:26:38.416614 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5daca71_3a59_47e5_982e_88069c44e2d8.slice/crio-ebad479c24438b0a515a70a6d933886e64e4ac204317ed935ddfcd28f06db82b WatchSource:0}: Error finding container ebad479c24438b0a515a70a6d933886e64e4ac204317ed935ddfcd28f06db82b: Status 404 returned error can't find the container with id ebad479c24438b0a515a70a6d933886e64e4ac204317ed935ddfcd28f06db82b Jul 06 22:26:38.912056 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.912030 2568 generic.go:356] "Generic (PLEG): container finished" podID="f5daca71-3a59-47e5-982e-88069c44e2d8" containerID="370d8bdded4dec0dae19515589ecf8e14929df2c142078c7e5022013694f6edb" exitCode=0 Jul 06 22:26:38.912211 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.912080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerDied","Data":"370d8bdded4dec0dae19515589ecf8e14929df2c142078c7e5022013694f6edb"} Jul 06 22:26:38.912211 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:38.912135 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"ebad479c24438b0a515a70a6d933886e64e4ac204317ed935ddfcd28f06db82b"} Jul 06 22:26:39.026231 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.026197 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c" path="/var/lib/kubelet/pods/d04bd861-cdfa-4fb3-a69e-8fe1842b3c0c/volumes" Jul 06 22:26:39.921068 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"5faf5532f0161e9db326c3c1003e64a2b3eeb7b255b71c5fbda1eb96b4af7cfe"} Jul 06 22:26:39.921479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921100 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"e3665025d16021b044a2e4741dc4e724b524a0c725da4166de3d8573a55d487a"} Jul 06 22:26:39.921479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921129 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"c4202c6554cd82386e0248cbf902887a6a928c96db607a5df699e7ec2b8e0964"} Jul 06 22:26:39.921479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"4fe48ca78a5376e9afa52922fb17ff008ad41e96c0e7303493c004b70b790dd3"} Jul 06 22:26:39.921479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"3a9bd68fe99a6083d9ed46de36b4d281281e1bbf187d50a54fb9544231317f6e"} Jul 06 22:26:39.921479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.921205 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5daca71-3a59-47e5-982e-88069c44e2d8","Type":"ContainerStarted","Data":"3067606ce681b794e6e8c12cd1015dab1246d36efa2728366a025bdc722fe568"} Jul 06 22:26:39.947201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:39.947141 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.929794249 podStartE2EDuration="2.947121692s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.327443ms" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:26:39.945079697 +0000 UTC m=+167.368966447" watchObservedRunningTime="2026-07-06 22:26:39.947121692 +0000 UTC m=+167.371008393" Jul 06 22:26:40.128660 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.128626 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn"] Jul 06 22:26:40.132114 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.132091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.134435 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134413 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 22:26:40.134574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134459 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 22:26:40.134669 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134655 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 22:26:40.134756 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134696 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h5wr9\"" Jul 06 22:26:40.134826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134802 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 22:26:40.134909 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.134893 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 22:26:40.140285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.140259 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 22:26:40.143603 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.143583 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn"] Jul 06 22:26:40.187759 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187688 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.187759 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187755 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-federate-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.187891 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-metrics-client-ca\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.187891 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.187891 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187877 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-serving-certs-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.188037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.188037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.187974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwq7v\" (UniqueName: \"kubernetes.io/projected/1bb1cd00-75e1-4768-ac29-f81881df394d-kube-api-access-fwq7v\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.188037 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.188011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.288985 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.288964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-metrics-client-ca\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289089 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.288995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289089 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-serving-certs-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289089 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289089 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289068 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwq7v\" (UniqueName: \"kubernetes.io/projected/1bb1cd00-75e1-4768-ac29-f81881df394d-kube-api-access-fwq7v\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-federate-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289739 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-metrics-client-ca\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.289876 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.289782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-serving-certs-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.290252 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.290231 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.291592 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.291572 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.291688 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.291638 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-telemeter-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.291946 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.291927 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-federate-client-tls\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.292022 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.292003 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1bb1cd00-75e1-4768-ac29-f81881df394d-secret-telemeter-client\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.297422 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.297402 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwq7v\" (UniqueName: \"kubernetes.io/projected/1bb1cd00-75e1-4768-ac29-f81881df394d-kube-api-access-fwq7v\") pod \"telemeter-client-79ddcc4bd5-v65jn\" (UID: \"1bb1cd00-75e1-4768-ac29-f81881df394d\") " pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.442367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.442308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" Jul 06 22:26:40.576695 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.576673 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn"] Jul 06 22:26:40.578743 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:26:40.578699 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb1cd00_75e1_4768_ac29_f81881df394d.slice/crio-3308f3fcd302518c8c03b3bc7c6b03eab93803809ab0790b9e1d29c2b0d99475 WatchSource:0}: Error finding container 3308f3fcd302518c8c03b3bc7c6b03eab93803809ab0790b9e1d29c2b0d99475: Status 404 returned error can't find the container with id 3308f3fcd302518c8c03b3bc7c6b03eab93803809ab0790b9e1d29c2b0d99475 Jul 06 22:26:40.928031 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:40.928002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" event={"ID":"1bb1cd00-75e1-4768-ac29-f81881df394d","Type":"ContainerStarted","Data":"3308f3fcd302518c8c03b3bc7c6b03eab93803809ab0790b9e1d29c2b0d99475"} Jul 06 22:26:42.945669 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:42.945636 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" event={"ID":"1bb1cd00-75e1-4768-ac29-f81881df394d","Type":"ContainerStarted","Data":"d3a81f9555ebdae08e1b561bbda00e18da559b54dfb6fb0849840d45df8526f6"} Jul 06 22:26:42.946066 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:42.945742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" event={"ID":"1bb1cd00-75e1-4768-ac29-f81881df394d","Type":"ContainerStarted","Data":"965878969f46f46cd5e0bc4dd7750f5c33fad9ed52f8ec11b85157e196f5349a"} Jul 06 22:26:42.946066 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:42.945763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" event={"ID":"1bb1cd00-75e1-4768-ac29-f81881df394d","Type":"ContainerStarted","Data":"9ec672448171b7f7171a930b57c6a0a5b353b622e5409e399e6ff3399994b1a4"} Jul 06 22:26:42.968355 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:42.968307 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79ddcc4bd5-v65jn" podStartSLOduration=1.152738239 podStartE2EDuration="2.968294169s" totalImagesPullingTime="1.81555593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:26:42.965951691 +0000 UTC m=+170.389838388" watchObservedRunningTime="2026-07-06 22:26:42.968294169 +0000 UTC m=+170.392180869" Jul 06 22:26:43.702523 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.702489 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:26:43.706142 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.706113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.718338 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.718314 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:26:43.765587 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.765563 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:43.818164 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818350 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818350 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhn26\" (UniqueName: \"kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818413 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.818413 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.818376 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.821070 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.821051 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:43.897555 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.897531 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:43.919511 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhn26\" (UniqueName: \"kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.919762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.919695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.920381 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.920352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.920458 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.920438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.920533 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.920509 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.920639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.920625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.921980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.921964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.922095 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.922079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.927123 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.927100 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhn26\" (UniqueName: \"kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26\") pod \"console-54fd6dddc6-2nxrs\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:43.949052 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:43.949031 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:44.016563 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.016545 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:44.147533 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.147504 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:26:44.150455 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:26:44.150429 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2780f3d_7cde_41e2_b6cb_51e1492b9584.slice/crio-f0a18de0ce0fcd8df85b482470c9ecf174b1439285e901ea748288a6a981808c WatchSource:0}: Error finding container f0a18de0ce0fcd8df85b482470c9ecf174b1439285e901ea748288a6a981808c: Status 404 returned error can't find the container with id f0a18de0ce0fcd8df85b482470c9ecf174b1439285e901ea748288a6a981808c Jul 06 22:26:44.500993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.500955 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:44.550633 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.550602 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:44.956260 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.956145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6dddc6-2nxrs" event={"ID":"e2780f3d-7cde-41e2-b6cb-51e1492b9584","Type":"ContainerStarted","Data":"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab"} Jul 06 22:26:44.956260 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.956229 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6dddc6-2nxrs" event={"ID":"e2780f3d-7cde-41e2-b6cb-51e1492b9584","Type":"ContainerStarted","Data":"f0a18de0ce0fcd8df85b482470c9ecf174b1439285e901ea748288a6a981808c"} Jul 06 22:26:44.974436 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:44.974393 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fd6dddc6-2nxrs" podStartSLOduration=1.9743787350000002 podStartE2EDuration="1.974378735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:26:44.972997819 +0000 UTC m=+172.396884518" watchObservedRunningTime="2026-07-06 22:26:44.974378735 +0000 UTC m=+172.398265434" Jul 06 22:26:54.016865 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:54.016833 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:54.017247 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:54.016888 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:54.021554 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:54.021532 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:55.011190 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:55.011156 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:26:55.057152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:55.057122 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:26:55.169153 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:55.169123 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:55.268948 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:55.268876 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:26:55.327199 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:26:55.327170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:20.085498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.085459 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57c484bd65-g2mtm" podUID="91674630-8306-448f-9047-9f5d85fc427d" containerName="console" containerID="cri-o://afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591" gracePeriod=15 Jul 06 22:27:20.333003 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.332980 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:27:20.393490 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393432 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393490 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393463 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393500 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393522 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393539 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393869 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393696 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvbmz\" (UniqueName: \"kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz\") pod \"91674630-8306-448f-9047-9f5d85fc427d\" (UID: \"91674630-8306-448f-9047-9f5d85fc427d\") " Jul 06 22:27:20.393916 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393888 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:27:20.393970 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393923 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca" (OuterVolumeSpecName: "service-ca") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:27:20.393970 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.393951 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config" (OuterVolumeSpecName: "console-config") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:27:20.394131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.394036 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-oauth-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.394131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.394052 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-service-ca\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.394131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.394060 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-console-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.394314 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.394283 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:27:20.395837 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.395815 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:27:20.395920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.395855 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:27:20.395920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.395867 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz" (OuterVolumeSpecName: "kube-api-access-jvbmz") pod "91674630-8306-448f-9047-9f5d85fc427d" (UID: "91674630-8306-448f-9047-9f5d85fc427d"). InnerVolumeSpecName "kube-api-access-jvbmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:27:20.495334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.495314 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91674630-8306-448f-9047-9f5d85fc427d-trusted-ca-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.495334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.495333 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvbmz\" (UniqueName: \"kubernetes.io/projected/91674630-8306-448f-9047-9f5d85fc427d-kube-api-access-jvbmz\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.495456 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.495342 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:20.495456 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:20.495351 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91674630-8306-448f-9047-9f5d85fc427d-console-oauth-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:27:21.109689 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.109658 2568 generic.go:356] "Generic (PLEG): container finished" podID="91674630-8306-448f-9047-9f5d85fc427d" containerID="afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591" exitCode=0 Jul 06 22:27:21.110072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.109701 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c484bd65-g2mtm" Jul 06 22:27:21.110072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.109744 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c484bd65-g2mtm" event={"ID":"91674630-8306-448f-9047-9f5d85fc427d","Type":"ContainerDied","Data":"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591"} Jul 06 22:27:21.110072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.109791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c484bd65-g2mtm" event={"ID":"91674630-8306-448f-9047-9f5d85fc427d","Type":"ContainerDied","Data":"fa712b68f8f001fd5680037c20a194c6aa7d89366d1b9cf0873dc085ccbaeb55"} Jul 06 22:27:21.110072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.109812 2568 scope.go:117] "RemoveContainer" containerID="afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591" Jul 06 22:27:21.118247 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.118233 2568 scope.go:117] "RemoveContainer" containerID="afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591" Jul 06 22:27:21.118467 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:27:21.118451 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591\": container with ID starting with afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591 not found: ID does not exist" containerID="afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591" Jul 06 22:27:21.118519 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.118474 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591"} err="failed to get container status \"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591\": rpc error: code = NotFound desc = could not find container \"afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591\": container with ID starting with afb4dfadf91fb365a382b4856bcf5feece7e7bc02689b5e825b90a14df988591 not found: ID does not exist" Jul 06 22:27:21.125592 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.125570 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:27:21.127472 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:21.127454 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c484bd65-g2mtm"] Jul 06 22:27:23.024574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:23.024539 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91674630-8306-448f-9047-9f5d85fc427d" path="/var/lib/kubelet/pods/91674630-8306-448f-9047-9f5d85fc427d/volumes" Jul 06 22:27:29.537454 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:29.537418 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:29.638017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:29.637986 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:38.163498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:38.163466 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:50.288265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:50.288231 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:50.346557 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:50.346529 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:54.159193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:27:54.159157 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:00.470566 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.470530 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:28:00.471169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.471148 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91674630-8306-448f-9047-9f5d85fc427d" containerName="console" Jul 06 22:28:00.471255 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.471173 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="91674630-8306-448f-9047-9f5d85fc427d" containerName="console" Jul 06 22:28:00.471310 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.471292 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="91674630-8306-448f-9047-9f5d85fc427d" containerName="console" Jul 06 22:28:00.474282 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.474266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.486191 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.486168 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:28:00.494326 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9w64\" (UniqueName: \"kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494336 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494558 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494558 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.494648 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.494588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.526293 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.526271 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:00.579616 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.579593 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:00.594985 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.594964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595243 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9w64\" (UniqueName: \"kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595243 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595243 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595169 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595884 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.595999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.595917 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.596065 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.596051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.596184 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.596070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.597845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.597820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.598145 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.598125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.603283 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.603261 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9w64\" (UniqueName: \"kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64\") pod \"console-64db94cbb5-t4rj8\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.784533 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.784507 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:00.916863 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:00.916832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:28:00.919908 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:28:00.919883 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf4f7f5_3f32_4d99_997e_6478126a5ef9.slice/crio-9ad37b2593c360de349388de2eb50a83b1bc8ce96088893c68114dff3c26edd4 WatchSource:0}: Error finding container 9ad37b2593c360de349388de2eb50a83b1bc8ce96088893c68114dff3c26edd4: Status 404 returned error can't find the container with id 9ad37b2593c360de349388de2eb50a83b1bc8ce96088893c68114dff3c26edd4 Jul 06 22:28:01.278188 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:01.278150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db94cbb5-t4rj8" event={"ID":"2bf4f7f5-3f32-4d99-997e-6478126a5ef9","Type":"ContainerStarted","Data":"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37"} Jul 06 22:28:01.278366 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:01.278203 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db94cbb5-t4rj8" event={"ID":"2bf4f7f5-3f32-4d99-997e-6478126a5ef9","Type":"ContainerStarted","Data":"9ad37b2593c360de349388de2eb50a83b1bc8ce96088893c68114dff3c26edd4"} Jul 06 22:28:01.297526 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:01.297481 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64db94cbb5-t4rj8" podStartSLOduration=1.2974661109999999 podStartE2EDuration="1.297466111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:01.296527675 +0000 UTC m=+248.720414433" watchObservedRunningTime="2026-07-06 22:28:01.297466111 +0000 UTC m=+248.721352810" Jul 06 22:28:02.266017 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:02.265979 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:02.319861 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:02.319834 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:08.458394 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:08.458364 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:08.559936 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:08.559904 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:10.785460 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:10.785421 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:10.785886 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:10.785513 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:10.790255 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:10.790235 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:11.321759 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:11.321733 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:28:11.376409 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:11.376381 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:28:11.508893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:11.508850 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:11.616429 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:11.616359 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:11.700355 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:11.700309 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.784527 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:15.784424 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.877418 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:15.877387 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:36.399529 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.399472 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54fd6dddc6-2nxrs" podUID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" containerName="console" containerID="cri-o://50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab" gracePeriod=15 Jul 06 22:28:36.641622 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.641596 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:28:36.769322 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769295 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769437 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769332 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769437 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769353 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769437 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769381 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769551 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769522 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhn26\" (UniqueName: \"kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769601 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769574 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769655 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769618 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert\") pod \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\" (UID: \"e2780f3d-7cde-41e2-b6cb-51e1492b9584\") " Jul 06 22:28:36.769735 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769660 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config" (OuterVolumeSpecName: "console-config") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:28:36.769825 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769800 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:28:36.769953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.769839 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:28:36.770040 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.770022 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-service-ca\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.770101 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.770047 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-trusted-ca-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.770101 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.770056 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:28:36.770101 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.770061 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.771559 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.771534 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26" (OuterVolumeSpecName: "kube-api-access-rhn26") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "kube-api-access-rhn26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:28:36.771657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.771580 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:28:36.771657 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.771569 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2780f3d-7cde-41e2-b6cb-51e1492b9584" (UID: "e2780f3d-7cde-41e2-b6cb-51e1492b9584"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:28:36.870586 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.870555 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.870586 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.870587 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhn26\" (UniqueName: \"kubernetes.io/projected/e2780f3d-7cde-41e2-b6cb-51e1492b9584-kube-api-access-rhn26\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.870586 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.870597 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2780f3d-7cde-41e2-b6cb-51e1492b9584-console-oauth-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:36.870796 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:36.870605 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2780f3d-7cde-41e2-b6cb-51e1492b9584-oauth-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:28:37.426763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.426675 2568 generic.go:356] "Generic (PLEG): container finished" podID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" containerID="50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab" exitCode=0 Jul 06 22:28:37.426763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.426736 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fd6dddc6-2nxrs" Jul 06 22:28:37.426763 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.426751 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6dddc6-2nxrs" event={"ID":"e2780f3d-7cde-41e2-b6cb-51e1492b9584","Type":"ContainerDied","Data":"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab"} Jul 06 22:28:37.427217 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.426808 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fd6dddc6-2nxrs" event={"ID":"e2780f3d-7cde-41e2-b6cb-51e1492b9584","Type":"ContainerDied","Data":"f0a18de0ce0fcd8df85b482470c9ecf174b1439285e901ea748288a6a981808c"} Jul 06 22:28:37.427217 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.426829 2568 scope.go:117] "RemoveContainer" containerID="50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab" Jul 06 22:28:37.435461 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.435444 2568 scope.go:117] "RemoveContainer" containerID="50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab" Jul 06 22:28:37.435742 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:28:37.435706 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab\": container with ID starting with 50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab not found: ID does not exist" containerID="50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab" Jul 06 22:28:37.435797 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.435750 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab"} err="failed to get container status \"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab\": rpc error: code = NotFound desc = could not find container \"50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab\": container with ID starting with 50c3010429a5292bace48fc1690abb7f1f66bde39e75b7731a4b4b06be215cab not found: ID does not exist" Jul 06 22:28:37.442743 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.442700 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:28:37.445833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:37.445815 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54fd6dddc6-2nxrs"] Jul 06 22:28:39.025366 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:39.025332 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" path="/var/lib/kubelet/pods/e2780f3d-7cde-41e2-b6cb-51e1492b9584/volumes" Jul 06 22:28:42.615073 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:42.615040 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:43.378901 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.378869 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8"] Jul 06 22:28:43.379200 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.379189 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" containerName="console" Jul 06 22:28:43.379244 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.379202 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" containerName="console" Jul 06 22:28:43.379284 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.379275 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2780f3d-7cde-41e2-b6cb-51e1492b9584" containerName="console" Jul 06 22:28:43.384524 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.384508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.388029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.388008 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:28:43.388149 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.388103 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbwk6\"" Jul 06 22:28:43.388803 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.388790 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:28:43.394543 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.394521 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8"] Jul 06 22:28:43.520423 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.520397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f877d\" (UniqueName: \"kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.520535 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.520462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.520535 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.520490 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.621473 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.621447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f877d\" (UniqueName: \"kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.621784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.621512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.621784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.621539 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.621859 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.621837 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.621893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.621878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.631206 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.631156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f877d\" (UniqueName: \"kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.694632 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.694608 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:28:43.835988 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.835962 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8"] Jul 06 22:28:43.838658 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:28:43.838634 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1456975d_ebd5_4061_9a93_8f91f7201e80.slice/crio-e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f WatchSource:0}: Error finding container e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f: Status 404 returned error can't find the container with id e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f Jul 06 22:28:43.867552 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:43.867528 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:44.460234 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:44.460202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" event={"ID":"1456975d-ebd5-4061-9a93-8f91f7201e80","Type":"ContainerStarted","Data":"e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f"} Jul 06 22:28:50.489161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:50.489132 2568 generic.go:356] "Generic (PLEG): container finished" podID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerID="897206cc9409c9e0e163de09a23a19ac099b89778f4a9e0461c2f12aeca28c0d" exitCode=0 Jul 06 22:28:50.489529 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:50.489225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" event={"ID":"1456975d-ebd5-4061-9a93-8f91f7201e80","Type":"ContainerDied","Data":"897206cc9409c9e0e163de09a23a19ac099b89778f4a9e0461c2f12aeca28c0d"} Jul 06 22:28:52.500659 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:52.500631 2568 generic.go:356] "Generic (PLEG): container finished" podID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerID="ac92e5a8347c14e94ea184d860177dcaf3888bb779b5aead4cfff2a071881929" exitCode=0 Jul 06 22:28:52.500980 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:52.500698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" event={"ID":"1456975d-ebd5-4061-9a93-8f91f7201e80","Type":"ContainerDied","Data":"ac92e5a8347c14e94ea184d860177dcaf3888bb779b5aead4cfff2a071881929"} Jul 06 22:28:52.943159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:52.943129 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:28:52.947724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:52.947687 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:28:52.956955 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:52.956937 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:28:56.390668 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:56.390630 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:56.442062 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:28:56.442034 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:00.539797 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:00.539318 2568 generic.go:356] "Generic (PLEG): container finished" podID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerID="a9fa177710ae97296e6f11b07357e1c16b788cc7605c40bcac85582b12664b1b" exitCode=0 Jul 06 22:29:00.539797 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:00.539394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" event={"ID":"1456975d-ebd5-4061-9a93-8f91f7201e80","Type":"ContainerDied","Data":"a9fa177710ae97296e6f11b07357e1c16b788cc7605c40bcac85582b12664b1b"} Jul 06 22:29:01.679212 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.679189 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:29:01.778333 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.778308 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle\") pod \"1456975d-ebd5-4061-9a93-8f91f7201e80\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " Jul 06 22:29:01.778451 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.778343 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util\") pod \"1456975d-ebd5-4061-9a93-8f91f7201e80\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " Jul 06 22:29:01.778451 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.778365 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f877d\" (UniqueName: \"kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d\") pod \"1456975d-ebd5-4061-9a93-8f91f7201e80\" (UID: \"1456975d-ebd5-4061-9a93-8f91f7201e80\") " Jul 06 22:29:01.779118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.779092 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle" (OuterVolumeSpecName: "bundle") pod "1456975d-ebd5-4061-9a93-8f91f7201e80" (UID: "1456975d-ebd5-4061-9a93-8f91f7201e80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:01.780447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.780424 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d" (OuterVolumeSpecName: "kube-api-access-f877d") pod "1456975d-ebd5-4061-9a93-8f91f7201e80" (UID: "1456975d-ebd5-4061-9a93-8f91f7201e80"). InnerVolumeSpecName "kube-api-access-f877d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:01.782647 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.782620 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util" (OuterVolumeSpecName: "util") pod "1456975d-ebd5-4061-9a93-8f91f7201e80" (UID: "1456975d-ebd5-4061-9a93-8f91f7201e80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:01.879368 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.879313 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:01.879368 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.879336 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1456975d-ebd5-4061-9a93-8f91f7201e80-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:01.879368 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:01.879344 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f877d\" (UniqueName: \"kubernetes.io/projected/1456975d-ebd5-4061-9a93-8f91f7201e80-kube-api-access-f877d\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:02.549640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:02.549609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" event={"ID":"1456975d-ebd5-4061-9a93-8f91f7201e80","Type":"ContainerDied","Data":"e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f"} Jul 06 22:29:02.549640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:02.549632 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qvdk8" Jul 06 22:29:02.549892 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:02.549653 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e48b6a3d2b510607b1f9765b42fd7e8be57751aed1f829687579aa76af2bfc3f" Jul 06 22:29:04.390057 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:04.390026 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:05.232235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:05.232194 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:06.383355 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383324 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5"] Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383672 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="util" Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383685 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="util" Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383705 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="pull" Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383723 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="pull" Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383735 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="extract" Jul 06 22:29:06.383762 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383741 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="extract" Jul 06 22:29:06.383950 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.383794 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1456975d-ebd5-4061-9a93-8f91f7201e80" containerName="extract" Jul 06 22:29:06.387671 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.387653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.390507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.390395 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4nqnc\"" Jul 06 22:29:06.390507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.390399 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 22:29:06.390507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.390481 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:29:06.402053 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.402033 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5"] Jul 06 22:29:06.412834 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.412812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262f9\" (UniqueName: \"kubernetes.io/projected/63424dd5-6a94-4e1e-808a-2f376329b7a6-kube-api-access-262f9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.412927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.412851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63424dd5-6a94-4e1e-808a-2f376329b7a6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.513579 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.513555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262f9\" (UniqueName: \"kubernetes.io/projected/63424dd5-6a94-4e1e-808a-2f376329b7a6-kube-api-access-262f9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.513677 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.513591 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63424dd5-6a94-4e1e-808a-2f376329b7a6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.513919 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.513903 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63424dd5-6a94-4e1e-808a-2f376329b7a6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.521617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.521597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-262f9\" (UniqueName: \"kubernetes.io/projected/63424dd5-6a94-4e1e-808a-2f376329b7a6-kube-api-access-262f9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wjkj5\" (UID: \"63424dd5-6a94-4e1e-808a-2f376329b7a6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.696422 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.696361 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" Jul 06 22:29:06.825466 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.825438 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5"] Jul 06 22:29:06.827284 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:06.827254 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63424dd5_6a94_4e1e_808a_2f376329b7a6.slice/crio-e84361f4e8494710d3a24b0c004b8b76298a18318ec905a5e0fe05f15482c3b4 WatchSource:0}: Error finding container e84361f4e8494710d3a24b0c004b8b76298a18318ec905a5e0fe05f15482c3b4: Status 404 returned error can't find the container with id e84361f4e8494710d3a24b0c004b8b76298a18318ec905a5e0fe05f15482c3b4 Jul 06 22:29:06.829866 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:06.829849 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:29:07.580301 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:07.580259 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" event={"ID":"63424dd5-6a94-4e1e-808a-2f376329b7a6","Type":"ContainerStarted","Data":"e84361f4e8494710d3a24b0c004b8b76298a18318ec905a5e0fe05f15482c3b4"} Jul 06 22:29:08.194813 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:08.194785 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:08.294846 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:08.294811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:08.586929 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:08.586898 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" event={"ID":"63424dd5-6a94-4e1e-808a-2f376329b7a6","Type":"ContainerStarted","Data":"e98d187acef091796d36c28eeaab529ccfdf62b0163b22634d29a1085fa44e8f"} Jul 06 22:29:08.631101 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:08.631054 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wjkj5" podStartSLOduration=1.244589644 podStartE2EDuration="2.631033726s" totalImagesPullingTime="1.386444082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:08.628965012 +0000 UTC m=+316.052851715" watchObservedRunningTime="2026-07-06 22:29:08.631033726 +0000 UTC m=+316.054920430" Jul 06 22:29:09.037273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:09.037243 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:09.204591 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:09.204567 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.041821 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.041791 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.105700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.105674 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6"] Jul 06 22:29:10.108180 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.108165 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.115138 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.115112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:29:10.115248 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.115133 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:29:10.115248 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.115144 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbwk6\"" Jul 06 22:29:10.125215 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.125191 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6"] Jul 06 22:29:10.137994 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.137973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.138078 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.138011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b482\" (UniqueName: \"kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.138126 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.138112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.191586 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.191553 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.238620 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.238596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b482\" (UniqueName: \"kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.238743 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.238654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.238743 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.238677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.239005 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.238989 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.239054 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.239020 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.257728 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.257686 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b482\" (UniqueName: \"kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.418120 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.418064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:10.553176 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.553135 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6"] Jul 06 22:29:10.555204 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:10.555179 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d268c4_07e6_44a0_9a98_a4750d59cebc.slice/crio-d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14 WatchSource:0}: Error finding container d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14: Status 404 returned error can't find the container with id d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14 Jul 06 22:29:10.598177 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:10.598149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" event={"ID":"41d268c4-07e6-44a0-9a98-a4750d59cebc","Type":"ContainerStarted","Data":"d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14"} Jul 06 22:29:11.609593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:11.609511 2568 generic.go:356] "Generic (PLEG): container finished" podID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerID="72428aabef025c129ff3b03dae85210fb666c04498b15f4805a1f6f2ec6feff5" exitCode=0 Jul 06 22:29:11.609593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:11.609551 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" event={"ID":"41d268c4-07e6-44a0-9a98-a4750d59cebc","Type":"ContainerDied","Data":"72428aabef025c129ff3b03dae85210fb666c04498b15f4805a1f6f2ec6feff5"} Jul 06 22:29:12.313349 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.313315 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:12.531911 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.531875 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:12.849079 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.848895 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9"] Jul 06 22:29:12.855030 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.855010 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.856393 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.856369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.856530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.856423 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mjgc\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-kube-api-access-6mjgc\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.857678 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.857570 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 22:29:12.858288 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.858264 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2sf5g\"" Jul 06 22:29:12.858410 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.858348 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 22:29:12.859820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.859799 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9"] Jul 06 22:29:12.957478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.957436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.957641 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.957501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mjgc\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-kube-api-access-6mjgc\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.967635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.967557 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:12.967826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:12.967777 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mjgc\" (UniqueName: \"kubernetes.io/projected/1987fc95-9427-4f83-b61d-5eff32adb02d-kube-api-access-6mjgc\") pod \"cert-manager-cainjector-559cdd8c87-tt2n9\" (UID: \"1987fc95-9427-4f83-b61d-5eff32adb02d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:13.173097 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:13.173006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" Jul 06 22:29:13.434264 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:13.434241 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9"] Jul 06 22:29:13.436209 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:13.436185 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1987fc95_9427_4f83_b61d_5eff32adb02d.slice/crio-3b4f2c8c0e9d6ccd6f704cb94973f416a19fbc6d2e5d8ae618312ccd881b73ae WatchSource:0}: Error finding container 3b4f2c8c0e9d6ccd6f704cb94973f416a19fbc6d2e5d8ae618312ccd881b73ae: Status 404 returned error can't find the container with id 3b4f2c8c0e9d6ccd6f704cb94973f416a19fbc6d2e5d8ae618312ccd881b73ae Jul 06 22:29:13.620607 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:13.620579 2568 generic.go:356] "Generic (PLEG): container finished" podID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerID="db9f8fc3a251c85e1b55294ae97dca085f6e38fd5b2a77ddaa98d3b18851cf59" exitCode=0 Jul 06 22:29:13.620748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:13.620664 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" event={"ID":"41d268c4-07e6-44a0-9a98-a4750d59cebc","Type":"ContainerDied","Data":"db9f8fc3a251c85e1b55294ae97dca085f6e38fd5b2a77ddaa98d3b18851cf59"} Jul 06 22:29:13.621820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:13.621800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" event={"ID":"1987fc95-9427-4f83-b61d-5eff32adb02d","Type":"ContainerStarted","Data":"3b4f2c8c0e9d6ccd6f704cb94973f416a19fbc6d2e5d8ae618312ccd881b73ae"} Jul 06 22:29:14.630124 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:14.630086 2568 generic.go:356] "Generic (PLEG): container finished" podID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerID="b7aa00a8f0924bf4688b25ded792cdc9cf1ee8d45a42e9363be6b902362276bd" exitCode=0 Jul 06 22:29:14.630566 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:14.630171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" event={"ID":"41d268c4-07e6-44a0-9a98-a4750d59cebc","Type":"ContainerDied","Data":"b7aa00a8f0924bf4688b25ded792cdc9cf1ee8d45a42e9363be6b902362276bd"} Jul 06 22:29:14.992263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:14.992182 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:15.055748 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.055705 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:15.766358 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.766338 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:15.780154 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.780131 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util\") pod \"41d268c4-07e6-44a0-9a98-a4750d59cebc\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " Jul 06 22:29:15.780280 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.780184 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b482\" (UniqueName: \"kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482\") pod \"41d268c4-07e6-44a0-9a98-a4750d59cebc\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " Jul 06 22:29:15.780280 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.780233 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle\") pod \"41d268c4-07e6-44a0-9a98-a4750d59cebc\" (UID: \"41d268c4-07e6-44a0-9a98-a4750d59cebc\") " Jul 06 22:29:15.780680 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.780654 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle" (OuterVolumeSpecName: "bundle") pod "41d268c4-07e6-44a0-9a98-a4750d59cebc" (UID: "41d268c4-07e6-44a0-9a98-a4750d59cebc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:15.782147 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.782125 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482" (OuterVolumeSpecName: "kube-api-access-6b482") pod "41d268c4-07e6-44a0-9a98-a4750d59cebc" (UID: "41d268c4-07e6-44a0-9a98-a4750d59cebc"). InnerVolumeSpecName "kube-api-access-6b482". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:15.785799 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.785776 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util" (OuterVolumeSpecName: "util") pod "41d268c4-07e6-44a0-9a98-a4750d59cebc" (UID: "41d268c4-07e6-44a0-9a98-a4750d59cebc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:15.881667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.881638 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:15.881667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.881665 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b482\" (UniqueName: \"kubernetes.io/projected/41d268c4-07e6-44a0-9a98-a4750d59cebc-kube-api-access-6b482\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:15.881667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:15.881674 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41d268c4-07e6-44a0-9a98-a4750d59cebc-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:16.646705 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:16.646664 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" event={"ID":"41d268c4-07e6-44a0-9a98-a4750d59cebc","Type":"ContainerDied","Data":"d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14"} Jul 06 22:29:16.646913 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:16.646681 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5fbv6" Jul 06 22:29:16.646913 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:16.646756 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d83debadb23485a3fbb5682b3dfa3c2dac0693faf67b1b7b33568fe953f22a14" Jul 06 22:29:16.648286 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:16.648262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" event={"ID":"1987fc95-9427-4f83-b61d-5eff32adb02d","Type":"ContainerStarted","Data":"665ada62c0a347433e176b937320691ee76d67f4914a7a96fece7d3ba7abcfae"} Jul 06 22:29:16.813076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:16.813029 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tt2n9" podStartSLOduration=2.570552908 podStartE2EDuration="4.813009233s" totalImagesPullingTime="2.242456325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:16.669940914 +0000 UTC m=+324.093827616" watchObservedRunningTime="2026-07-06 22:29:16.813009233 +0000 UTC m=+324.236895935" Jul 06 22:29:18.458392 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:18.458360 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:18.688599 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:18.688569 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:20.084904 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.084874 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:20.415650 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415569 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmw46"] Jul 06 22:29:20.415959 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415945 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="extract" Jul 06 22:29:20.416009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415961 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="extract" Jul 06 22:29:20.416009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415973 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="pull" Jul 06 22:29:20.416009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415980 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="pull" Jul 06 22:29:20.416009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.415998 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="util" Jul 06 22:29:20.416009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.416004 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="util" Jul 06 22:29:20.416168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.416059 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d268c4-07e6-44a0-9a98-a4750d59cebc" containerName="extract" Jul 06 22:29:20.418116 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.418101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.418858 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.418838 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jk2l\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-kube-api-access-6jk2l\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.418963 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.418867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.421991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.421974 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hlxb4\"" Jul 06 22:29:20.432563 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.432540 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmw46"] Jul 06 22:29:20.519860 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.519834 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.520015 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.519932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jk2l\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-kube-api-access-6jk2l\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.537507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.537483 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jk2l\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-kube-api-access-6jk2l\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.537843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.537826 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/792bf71b-cacc-449c-8d83-4e2219ad9d1f-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmw46\" (UID: \"792bf71b-cacc-449c-8d83-4e2219ad9d1f\") " pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.664251 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.664221 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9"] Jul 06 22:29:20.667007 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.666952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.669953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.669933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:29:20.670110 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.670078 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zj5j7\"" Jul 06 22:29:20.670365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.670351 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 22:29:20.712279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.712254 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9"] Jul 06 22:29:20.721825 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.721803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnqbt\" (UniqueName: \"kubernetes.io/projected/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-kube-api-access-nnqbt\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.721912 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.721843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.726570 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.726547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmw46" Jul 06 22:29:20.823263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.823234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.823395 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.823336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnqbt\" (UniqueName: \"kubernetes.io/projected/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-kube-api-access-nnqbt\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.823685 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.823662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.862201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.862176 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnqbt\" (UniqueName: \"kubernetes.io/projected/fdea8107-dc78-4763-a5dc-69dfbb5c1c86-kube-api-access-nnqbt\") pod \"openshift-lws-operator-fd8ccff4c-z6ph9\" (UID: \"fdea8107-dc78-4763-a5dc-69dfbb5c1c86\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:20.920167 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:20.920143 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod792bf71b_cacc_449c_8d83_4e2219ad9d1f.slice/crio-b62e6bca071c86b993ca0f6b9b35676d1ab06f4e089455479151cbadcf412e07 WatchSource:0}: Error finding container b62e6bca071c86b993ca0f6b9b35676d1ab06f4e089455479151cbadcf412e07: Status 404 returned error can't find the container with id b62e6bca071c86b993ca0f6b9b35676d1ab06f4e089455479151cbadcf412e07 Jul 06 22:29:20.920311 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.920292 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmw46"] Jul 06 22:29:20.976135 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:20.976113 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" Jul 06 22:29:21.116781 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:21.116747 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9"] Jul 06 22:29:21.121425 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:21.121402 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdea8107_dc78_4763_a5dc_69dfbb5c1c86.slice/crio-0b8ee11fa228daa8ec70112516840051e03f61f29cb6550af7ab08985c99efa2 WatchSource:0}: Error finding container 0b8ee11fa228daa8ec70112516840051e03f61f29cb6550af7ab08985c99efa2: Status 404 returned error can't find the container with id 0b8ee11fa228daa8ec70112516840051e03f61f29cb6550af7ab08985c99efa2 Jul 06 22:29:21.675312 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:21.675276 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" event={"ID":"fdea8107-dc78-4763-a5dc-69dfbb5c1c86","Type":"ContainerStarted","Data":"0b8ee11fa228daa8ec70112516840051e03f61f29cb6550af7ab08985c99efa2"} Jul 06 22:29:21.677033 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:21.676988 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmw46" event={"ID":"792bf71b-cacc-449c-8d83-4e2219ad9d1f","Type":"ContainerStarted","Data":"106fa3e79a283b34038c72045ec8cdc6ed81206c3cf50e4d00a74c7120c62c45"} Jul 06 22:29:21.677033 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:21.677033 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmw46" event={"ID":"792bf71b-cacc-449c-8d83-4e2219ad9d1f","Type":"ContainerStarted","Data":"b62e6bca071c86b993ca0f6b9b35676d1ab06f4e089455479151cbadcf412e07"} Jul 06 22:29:21.704270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:21.704200 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jmw46" podStartSLOduration=1.7041829590000002 podStartE2EDuration="1.704182959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:21.704005251 +0000 UTC m=+329.127891952" watchObservedRunningTime="2026-07-06 22:29:21.704182959 +0000 UTC m=+329.128069662" Jul 06 22:29:22.683556 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:22.683523 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" event={"ID":"fdea8107-dc78-4763-a5dc-69dfbb5c1c86","Type":"ContainerStarted","Data":"34a5bc645277ed0c43fcd658340c2b6bab397f4288976949c961c61ffb0cdf4c"} Jul 06 22:29:23.587997 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:23.587955 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:23.787791 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:23.787764 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:25.486457 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.486402 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z6ph9" podStartSLOduration=4.004663338 podStartE2EDuration="5.486382719s" totalImagesPullingTime="1.481719381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:22.71707607 +0000 UTC m=+330.140962769" watchObservedRunningTime="2026-07-06 22:29:25.486382719 +0000 UTC m=+332.910269418" Jul 06 22:29:25.487421 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.487388 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm"] Jul 06 22:29:25.490621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.490600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.493609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.493586 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 22:29:25.493609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.493600 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 22:29:25.493788 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.493645 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbwk6\"" Jul 06 22:29:25.500182 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.500159 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm"] Jul 06 22:29:25.557604 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.557582 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsvxx\" (UniqueName: \"kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.557729 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.557613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.557729 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.557648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.664506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.659166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.664506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.659325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsvxx\" (UniqueName: \"kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.664506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.659378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.664506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.659580 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.664506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.659758 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.668227 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.668205 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsvxx\" (UniqueName: \"kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.801128 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.801106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:25.952816 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.952732 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm"] Jul 06 22:29:25.954915 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:25.954885 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25bf462_0601_46f3_9c2c_e96f8550fea8.slice/crio-1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d WatchSource:0}: Error finding container 1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d: Status 404 returned error can't find the container with id 1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d Jul 06 22:29:25.959115 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:25.959086 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:26.703177 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:26.703146 2568 generic.go:356] "Generic (PLEG): container finished" podID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerID="70dbc76a7f63093743a53da9af53437ba2c2542763f2fbc667541e593c1308d0" exitCode=0 Jul 06 22:29:26.703536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:26.703225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" event={"ID":"b25bf462-0601-46f3-9c2c-e96f8550fea8","Type":"ContainerDied","Data":"70dbc76a7f63093743a53da9af53437ba2c2542763f2fbc667541e593c1308d0"} Jul 06 22:29:26.703536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:26.703271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" event={"ID":"b25bf462-0601-46f3-9c2c-e96f8550fea8","Type":"ContainerStarted","Data":"1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d"} Jul 06 22:29:27.711056 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:27.711028 2568 generic.go:356] "Generic (PLEG): container finished" podID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerID="13bf4fc95ef125e3feed0e7e8b9c03fcd6317fdc52f44a586cfc6c075b7b673c" exitCode=0 Jul 06 22:29:27.711402 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:27.711093 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" event={"ID":"b25bf462-0601-46f3-9c2c-e96f8550fea8","Type":"ContainerDied","Data":"13bf4fc95ef125e3feed0e7e8b9c03fcd6317fdc52f44a586cfc6c075b7b673c"} Jul 06 22:29:28.717888 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:28.717859 2568 generic.go:356] "Generic (PLEG): container finished" podID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerID="d8997ed917e8ffdb0466c99432fd6b4de20d5593a1faa026458d954213581a2e" exitCode=0 Jul 06 22:29:28.718301 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:28.717945 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" event={"ID":"b25bf462-0601-46f3-9c2c-e96f8550fea8","Type":"ContainerDied","Data":"d8997ed917e8ffdb0466c99432fd6b4de20d5593a1faa026458d954213581a2e"} Jul 06 22:29:29.847576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.847553 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:29.891742 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.891703 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle\") pod \"b25bf462-0601-46f3-9c2c-e96f8550fea8\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " Jul 06 22:29:29.891874 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.891784 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsvxx\" (UniqueName: \"kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx\") pod \"b25bf462-0601-46f3-9c2c-e96f8550fea8\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " Jul 06 22:29:29.891874 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.891831 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util\") pod \"b25bf462-0601-46f3-9c2c-e96f8550fea8\" (UID: \"b25bf462-0601-46f3-9c2c-e96f8550fea8\") " Jul 06 22:29:29.892433 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.892411 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle" (OuterVolumeSpecName: "bundle") pod "b25bf462-0601-46f3-9c2c-e96f8550fea8" (UID: "b25bf462-0601-46f3-9c2c-e96f8550fea8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:29.893803 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.893773 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx" (OuterVolumeSpecName: "kube-api-access-fsvxx") pod "b25bf462-0601-46f3-9c2c-e96f8550fea8" (UID: "b25bf462-0601-46f3-9c2c-e96f8550fea8"). InnerVolumeSpecName "kube-api-access-fsvxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:29.896992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.896960 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util" (OuterVolumeSpecName: "util") pod "b25bf462-0601-46f3-9c2c-e96f8550fea8" (UID: "b25bf462-0601-46f3-9c2c-e96f8550fea8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:29.992738 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.992641 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsvxx\" (UniqueName: \"kubernetes.io/projected/b25bf462-0601-46f3-9c2c-e96f8550fea8-kube-api-access-fsvxx\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:29.992738 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.992676 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:29.992738 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:29.992685 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b25bf462-0601-46f3-9c2c-e96f8550fea8-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:29:30.728998 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:30.728967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" event={"ID":"b25bf462-0601-46f3-9c2c-e96f8550fea8","Type":"ContainerDied","Data":"1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d"} Jul 06 22:29:30.728998 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:30.728985 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrfxxm" Jul 06 22:29:30.729193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:30.729009 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f05b1e49e27e2d70ae3553cd215df3aa38b99c1236661875d620249bf0f312d" Jul 06 22:29:34.170118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:34.170087 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:34.229118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:34.229092 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:41.411605 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:41.411573 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:41.504948 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:41.504919 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.031040 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.031009 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.339513 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.339443 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.443541 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.443517 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.479438 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479411 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f"] Jul 06 22:29:42.479836 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479821 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="extract" Jul 06 22:29:42.479836 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479837 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="extract" Jul 06 22:29:42.479968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479861 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="pull" Jul 06 22:29:42.479968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479867 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="pull" Jul 06 22:29:42.479968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479878 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="util" Jul 06 22:29:42.479968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479883 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="util" Jul 06 22:29:42.479968 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.479945 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25bf462-0601-46f3-9c2c-e96f8550fea8" containerName="extract" Jul 06 22:29:42.483611 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.483596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.488955 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.488929 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:29:42.489109 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.489091 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:29:42.489178 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.489092 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:29:42.490908 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.490021 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nd4qr\"" Jul 06 22:29:42.490908 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.490507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:29:42.510628 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.510605 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f"] Jul 06 22:29:42.588472 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.588443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.588594 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.588489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-tmp\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.588594 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.588509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmxk\" (UniqueName: \"kubernetes.io/projected/bd756dfe-1513-40c8-815c-d0a52e286d40-kube-api-access-drmxk\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.588703 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.588598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-manifests\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.588794 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.588699 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-webhook-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.639184 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.639091 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.689443 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689420 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-tmp\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.689549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmxk\" (UniqueName: \"kubernetes.io/projected/bd756dfe-1513-40c8-815c-d0a52e286d40-kube-api-access-drmxk\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.689549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-manifests\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.689549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689519 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-webhook-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.689681 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.689949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.689929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-manifests\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.691561 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.691542 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd756dfe-1513-40c8-815c-d0a52e286d40-tmp\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.691811 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.691795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-webhook-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.692010 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.691991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd756dfe-1513-40c8-815c-d0a52e286d40-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.696947 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.696924 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmxk\" (UniqueName: \"kubernetes.io/projected/bd756dfe-1513-40c8-815c-d0a52e286d40-kube-api-access-drmxk\") pod \"opendatahub-operator-controller-manager-85fcf54485-pmr2f\" (UID: \"bd756dfe-1513-40c8-815c-d0a52e286d40\") " pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.744445 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.744422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.796221 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.796201 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:42.850266 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.850089 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:42.949890 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.949864 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f"] Jul 06 22:29:42.952204 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:29:42.952178 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd756dfe_1513_40c8_815c_d0a52e286d40.slice/crio-db97aaa452011fae7b56f1e4d8e96768fbece912c805a32c4cf9d17393d5df29 WatchSource:0}: Error finding container db97aaa452011fae7b56f1e4d8e96768fbece912c805a32c4cf9d17393d5df29: Status 404 returned error can't find the container with id db97aaa452011fae7b56f1e4d8e96768fbece912c805a32c4cf9d17393d5df29 Jul 06 22:29:42.956609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:42.956581 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:43.053999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:43.053969 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:43.153981 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:43.153914 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:43.792753 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:43.792704 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" event={"ID":"bd756dfe-1513-40c8-815c-d0a52e286d40","Type":"ContainerStarted","Data":"db97aaa452011fae7b56f1e4d8e96768fbece912c805a32c4cf9d17393d5df29"} Jul 06 22:29:44.169195 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:44.169088 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:44.270627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:44.270596 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:46.810144 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:46.810116 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" event={"ID":"bd756dfe-1513-40c8-815c-d0a52e286d40","Type":"ContainerStarted","Data":"a11bc6e33577294ac45471d88333e96953038dca29176e8b7d3247e11a8b2487"} Jul 06 22:29:47.816539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:47.816503 2568 generic.go:356] "Generic (PLEG): container finished" podID="bd756dfe-1513-40c8-815c-d0a52e286d40" containerID="a11bc6e33577294ac45471d88333e96953038dca29176e8b7d3247e11a8b2487" exitCode=0 Jul 06 22:29:47.816965 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:47.816565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" event={"ID":"bd756dfe-1513-40c8-815c-d0a52e286d40","Type":"ContainerDied","Data":"a11bc6e33577294ac45471d88333e96953038dca29176e8b7d3247e11a8b2487"} Jul 06 22:29:48.823626 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:48.823595 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" event={"ID":"bd756dfe-1513-40c8-815c-d0a52e286d40","Type":"ContainerStarted","Data":"fcb939b657fd9a9f0b8d7142404b67f0dc9aa3f051f54f3a32980a1586f4bdde"} Jul 06 22:29:48.824000 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:48.823746 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:29:48.847503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:48.847460 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" podStartSLOduration=2.594060712 podStartE2EDuration="6.847446491s" totalImagesPullingTime="3.1654384s" totalInitContainerRuntime="1.087947379s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:29:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:29:48.844992682 +0000 UTC m=+356.268879381" watchObservedRunningTime="2026-07-06 22:29:48.847446491 +0000 UTC m=+356.271333190" Jul 06 22:29:53.983934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:53.983899 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:54.099898 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:54.099873 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:59.832070 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:29:59.832044 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85fcf54485-pmr2f" Jul 06 22:30:01.656506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:01.656458 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:01.817220 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:01.817187 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:02.540853 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:02.540824 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:02.635446 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:02.635401 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:02.777506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:02.777455 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:03.030519 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:03.030489 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:03.301330 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:03.301211 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:03.400678 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:03.400634 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:03.452750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:03.452703 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:04.290875 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.290824 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:04.297992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.297967 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:04.308093 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.308072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.310756 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.310691 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 22:30:04.310967 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.310946 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 22:30:04.310967 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.310958 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:30:04.311258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.311239 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nkt4c\"" Jul 06 22:30:04.311258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.311255 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 22:30:04.314891 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.314860 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:04.354569 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.354547 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:04.464694 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hkj\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.464999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.464919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.565914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.565854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.565914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.565914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.565934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.565965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.565980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.566000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6hkj\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.566017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.566534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.566504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.568151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.568131 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.568268 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.568252 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.568349 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.568335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.568454 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.568435 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.573784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.573760 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6hkj\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.573905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.573883 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-ncnxm\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.618255 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.618235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:04.750462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.750440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:04.752545 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:30:04.752518 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30c4a00_311b_4dc2_8826_0254f63359a4.slice/crio-8da8c59c3919ff973c976e737dd3e06527a755a9c653b61cbef58dd91c3b26b8 WatchSource:0}: Error finding container 8da8c59c3919ff973c976e737dd3e06527a755a9c653b61cbef58dd91c3b26b8: Status 404 returned error can't find the container with id 8da8c59c3919ff973c976e737dd3e06527a755a9c653b61cbef58dd91c3b26b8 Jul 06 22:30:04.910131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:04.910068 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" event={"ID":"f30c4a00-311b-4dc2-8826-0254f63359a4","Type":"ContainerStarted","Data":"8da8c59c3919ff973c976e737dd3e06527a755a9c653b61cbef58dd91c3b26b8"} Jul 06 22:30:05.160623 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:05.160548 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:07.371913 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:07.371878 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:30:07.372162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:07.371946 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:30:07.927908 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:07.927870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" event={"ID":"f30c4a00-311b-4dc2-8826-0254f63359a4","Type":"ContainerStarted","Data":"7d7f3bd83e42ebef96f743772674bebb544faf518ce9f6e881432877aa72bcc1"} Jul 06 22:30:07.928081 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:07.928013 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:07.950915 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:07.950869 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" podStartSLOduration=1.3337221129999999 podStartE2EDuration="3.950854225s" totalImagesPullingTime="2.617132112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:30:07.950101125 +0000 UTC m=+375.373987825" watchObservedRunningTime="2026-07-06 22:30:07.950854225 +0000 UTC m=+375.374740924" Jul 06 22:30:08.294537 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:08.294503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:08.394077 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:08.394045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:08.934840 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:08.934815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:09.095083 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:09.095056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:09.507031 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:09.506999 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:10.010767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:10.010739 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:11.174769 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.174736 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj"] Jul 06 22:30:11.178442 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.178426 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.182279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.182252 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 22:30:11.182279 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.182260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qjwhf\"" Jul 06 22:30:11.182476 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.182258 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 22:30:11.182476 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.182332 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 22:30:11.191649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.191629 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj"] Jul 06 22:30:11.327688 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.327658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.327852 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.327793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e93aedf-25b3-44a0-b828-706ebb18c8c4-manager-config\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.327852 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.327844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-metrics-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.327967 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.327869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqtz\" (UniqueName: \"kubernetes.io/projected/4e93aedf-25b3-44a0-b828-706ebb18c8c4-kube-api-access-8lqtz\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.429065 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.428995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-metrics-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.429065 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.429023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqtz\" (UniqueName: \"kubernetes.io/projected/4e93aedf-25b3-44a0-b828-706ebb18c8c4-kube-api-access-8lqtz\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.429065 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.429051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.429271 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.429108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e93aedf-25b3-44a0-b828-706ebb18c8c4-manager-config\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.429778 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.429757 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e93aedf-25b3-44a0-b828-706ebb18c8c4-manager-config\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.431400 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.431381 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-metrics-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.431477 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.431462 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e93aedf-25b3-44a0-b828-706ebb18c8c4-cert\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.444077 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.444053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqtz\" (UniqueName: \"kubernetes.io/projected/4e93aedf-25b3-44a0-b828-706ebb18c8c4-kube-api-access-8lqtz\") pod \"lws-controller-manager-67b7b4db78-7tfjj\" (UID: \"4e93aedf-25b3-44a0-b828-706ebb18c8c4\") " pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.487576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.487560 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:11.644441 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.644379 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj"] Jul 06 22:30:11.646626 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:30:11.646597 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e93aedf_25b3_44a0_b828_706ebb18c8c4.slice/crio-14b8bf9adf75c41037a994c5c47d063c27d5f769d4b7ea81b134cd9aec139496 WatchSource:0}: Error finding container 14b8bf9adf75c41037a994c5c47d063c27d5f769d4b7ea81b134cd9aec139496: Status 404 returned error can't find the container with id 14b8bf9adf75c41037a994c5c47d063c27d5f769d4b7ea81b134cd9aec139496 Jul 06 22:30:11.949343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:11.949297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" event={"ID":"4e93aedf-25b3-44a0-b828-706ebb18c8c4","Type":"ContainerStarted","Data":"14b8bf9adf75c41037a994c5c47d063c27d5f769d4b7ea81b134cd9aec139496"} Jul 06 22:30:13.231417 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.231381 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:13.334396 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.334359 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:13.452254 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.452222 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:13.648071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.648043 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:13.738307 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.738278 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:13.962300 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.962206 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" event={"ID":"4e93aedf-25b3-44a0-b828-706ebb18c8c4","Type":"ContainerStarted","Data":"8d2b7624bafc854be0a08eeb56a7f3565599d57695dbd8c5d47db78c22687318"} Jul 06 22:30:13.962448 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:13.962331 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:30:14.799724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.799659 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" podStartSLOduration=1.8342995530000001 podStartE2EDuration="3.799641207s" totalImagesPullingTime="1.965341654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:30:13.990199315 +0000 UTC m=+381.414086015" watchObservedRunningTime="2026-07-06 22:30:14.799641207 +0000 UTC m=+382.223527906" Jul 06 22:30:14.800166 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.800150 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:14.800317 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.800300 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerName="discovery" containerID="cri-o://7d7f3bd83e42ebef96f743772674bebb544faf518ce9f6e881432877aa72bcc1" gracePeriod=30 Jul 06 22:30:14.933784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.933756 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ncnxm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:8080/ready\": dial tcp 10.132.0.37:8080: connect: connection refused" start-of-body= Jul 06 22:30:14.933909 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.933809 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.37:8080/ready\": dial tcp 10.132.0.37:8080: connect: connection refused" Jul 06 22:30:14.969747 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.969693 2568 generic.go:356] "Generic (PLEG): container finished" podID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerID="7d7f3bd83e42ebef96f743772674bebb544faf518ce9f6e881432877aa72bcc1" exitCode=0 Jul 06 22:30:14.969948 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:14.969919 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" event={"ID":"f30c4a00-311b-4dc2-8826-0254f63359a4","Type":"ContainerDied","Data":"7d7f3bd83e42ebef96f743772674bebb544faf518ce9f6e881432877aa72bcc1"} Jul 06 22:30:15.049606 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.049585 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:15.162505 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162428 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162505 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162485 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162521 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6hkj\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162559 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162598 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162655 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162704 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162680 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig\") pod \"f30c4a00-311b-4dc2-8826-0254f63359a4\" (UID: \"f30c4a00-311b-4dc2-8826-0254f63359a4\") " Jul 06 22:30:15.162999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.162938 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:30:15.163107 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.163091 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-ca-configmap\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.165094 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.165057 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:15.165245 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.165222 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts" (OuterVolumeSpecName: "cacerts") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:30:15.165305 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.165242 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:30:15.165305 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.165225 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj" (OuterVolumeSpecName: "kube-api-access-g6hkj") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "kube-api-access-g6hkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:30:15.165373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.165307 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:30:15.166386 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.166367 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs" (OuterVolumeSpecName: "local-certs") pod "f30c4a00-311b-4dc2-8826-0254f63359a4" (UID: "f30c4a00-311b-4dc2-8826-0254f63359a4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:30:15.263899 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263876 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30c4a00-311b-4dc2-8826-0254f63359a4-local-certs\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.263899 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263898 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6hkj\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-kube-api-access-g6hkj\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.264029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263907 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-cacerts\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.264029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263916 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-csr-dns-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.264029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263925 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-token\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.264029 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.263933 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f30c4a00-311b-4dc2-8826-0254f63359a4-istio-kubeconfig\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:30:15.975793 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.975758 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" event={"ID":"f30c4a00-311b-4dc2-8826-0254f63359a4","Type":"ContainerDied","Data":"8da8c59c3919ff973c976e737dd3e06527a755a9c653b61cbef58dd91c3b26b8"} Jul 06 22:30:15.976224 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.975809 2568 scope.go:117] "RemoveContainer" containerID="7d7f3bd83e42ebef96f743772674bebb544faf518ce9f6e881432877aa72bcc1" Jul 06 22:30:15.976224 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:15.975771 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm" Jul 06 22:30:16.017737 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:16.017693 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:16.020268 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:16.020245 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ncnxm"] Jul 06 22:30:17.024726 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:17.024685 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" path="/var/lib/kubelet/pods/f30c4a00-311b-4dc2-8826-0254f63359a4/volumes" Jul 06 22:30:24.971984 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:30:24.971953 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67b7b4db78-7tfjj" Jul 06 22:31:03.021382 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.021343 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:03.121936 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.121900 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:03.154697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.154670 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:03.155058 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.155044 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerName="discovery" Jul 06 22:31:03.155103 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.155060 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerName="discovery" Jul 06 22:31:03.155143 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.155133 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30c4a00-311b-4dc2-8826-0254f63359a4" containerName="discovery" Jul 06 22:31:03.157883 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.157860 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:03.161445 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.161421 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:31:03.161627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.161609 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jhg82\"" Jul 06 22:31:03.162596 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.162575 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:31:03.177469 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.177446 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:03.224499 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.224479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jzz\" (UniqueName: \"kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz\") pod \"kuadrant-operator-catalog-9jj7h\" (UID: \"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd\") " pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:03.238746 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.238697 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:03.325076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.325022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jzz\" (UniqueName: \"kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz\") pod \"kuadrant-operator-catalog-9jj7h\" (UID: \"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd\") " pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:03.337886 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.337860 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jzz\" (UniqueName: \"kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz\") pod \"kuadrant-operator-catalog-9jj7h\" (UID: \"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd\") " pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:03.469983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.469961 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:03.497638 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.497615 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:03.606480 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.606456 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:03.608661 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:03.608636 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b5cbf8_6d3d_4137_958a_ecd5cb3a69dd.slice/crio-8fb281d2f9f592c340400afcce0b4e0ff6efbb585cc2774318c97a99bc3f10b7 WatchSource:0}: Error finding container 8fb281d2f9f592c340400afcce0b4e0ff6efbb585cc2774318c97a99bc3f10b7: Status 404 returned error can't find the container with id 8fb281d2f9f592c340400afcce0b4e0ff6efbb585cc2774318c97a99bc3f10b7 Jul 06 22:31:03.709442 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.709419 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7j4f"] Jul 06 22:31:03.712667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.712650 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:03.721499 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.721480 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7j4f"] Jul 06 22:31:03.829221 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.829199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gjrw\" (UniqueName: \"kubernetes.io/projected/b940cf71-c3b5-487a-a742-bcb2a293a197-kube-api-access-6gjrw\") pod \"kuadrant-operator-catalog-n7j4f\" (UID: \"b940cf71-c3b5-487a-a742-bcb2a293a197\") " pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:03.929610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.929549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gjrw\" (UniqueName: \"kubernetes.io/projected/b940cf71-c3b5-487a-a742-bcb2a293a197-kube-api-access-6gjrw\") pod \"kuadrant-operator-catalog-n7j4f\" (UID: \"b940cf71-c3b5-487a-a742-bcb2a293a197\") " pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:03.937683 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.937663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gjrw\" (UniqueName: \"kubernetes.io/projected/b940cf71-c3b5-487a-a742-bcb2a293a197-kube-api-access-6gjrw\") pod \"kuadrant-operator-catalog-n7j4f\" (UID: \"b940cf71-c3b5-487a-a742-bcb2a293a197\") " pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:03.945632 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:03.945605 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:04.022471 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:04.022444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:04.152705 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:04.152642 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:04.176281 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:04.176261 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7j4f"] Jul 06 22:31:04.184646 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:04.184590 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb940cf71_c3b5_487a_a742_bcb2a293a197.slice/crio-c6c1f70c25d19183d9bb46be050624e5df15f3efeaeb4e182cb7b3126a4d4ecf WatchSource:0}: Error finding container c6c1f70c25d19183d9bb46be050624e5df15f3efeaeb4e182cb7b3126a4d4ecf: Status 404 returned error can't find the container with id c6c1f70c25d19183d9bb46be050624e5df15f3efeaeb4e182cb7b3126a4d4ecf Jul 06 22:31:04.212197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:04.212168 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" event={"ID":"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd","Type":"ContainerStarted","Data":"8fb281d2f9f592c340400afcce0b4e0ff6efbb585cc2774318c97a99bc3f10b7"} Jul 06 22:31:04.213378 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:04.213350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" event={"ID":"b940cf71-c3b5-487a-a742-bcb2a293a197","Type":"ContainerStarted","Data":"c6c1f70c25d19183d9bb46be050624e5df15f3efeaeb4e182cb7b3126a4d4ecf"} Jul 06 22:31:06.226768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.226730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" event={"ID":"b940cf71-c3b5-487a-a742-bcb2a293a197","Type":"ContainerStarted","Data":"d6206b24663f371a5b2d04729af06b9c82954531a4e5f2ed38ebcc328ca51d4b"} Jul 06 22:31:06.228218 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.228193 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" event={"ID":"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd","Type":"ContainerStarted","Data":"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377"} Jul 06 22:31:06.228327 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.228250 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" podUID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" containerName="registry-server" containerID="cri-o://6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377" gracePeriod=2 Jul 06 22:31:06.245979 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.245944 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" podStartSLOduration=1.971390096 podStartE2EDuration="3.245931171s" totalImagesPullingTime="1.274541075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:06.245441636 +0000 UTC m=+433.669328336" watchObservedRunningTime="2026-07-06 22:31:06.245931171 +0000 UTC m=+433.669817850" Jul 06 22:31:06.265187 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.265139 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" podStartSLOduration=1.418016753 podStartE2EDuration="3.265126904s" totalImagesPullingTime="1.847110151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:06.262886774 +0000 UTC m=+433.686773475" watchObservedRunningTime="2026-07-06 22:31:06.265126904 +0000 UTC m=+433.689013602" Jul 06 22:31:06.442734 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.442687 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:06.475238 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.475218 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:06.543700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.543673 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:06.552862 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.552843 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jzz\" (UniqueName: \"kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz\") pod \"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd\" (UID: \"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd\") " Jul 06 22:31:06.554939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.554917 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz" (OuterVolumeSpecName: "kube-api-access-h2jzz") pod "00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" (UID: "00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd"). InnerVolumeSpecName "kube-api-access-h2jzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:31:06.654240 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:06.654216 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jzz\" (UniqueName: \"kubernetes.io/projected/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd-kube-api-access-h2jzz\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:07.234635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.234604 2568 generic.go:356] "Generic (PLEG): container finished" podID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" containerID="6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377" exitCode=0 Jul 06 22:31:07.235085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.234652 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" Jul 06 22:31:07.235085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.234685 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" event={"ID":"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd","Type":"ContainerDied","Data":"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377"} Jul 06 22:31:07.235085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.234753 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9jj7h" event={"ID":"00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd","Type":"ContainerDied","Data":"8fb281d2f9f592c340400afcce0b4e0ff6efbb585cc2774318c97a99bc3f10b7"} Jul 06 22:31:07.235085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.234774 2568 scope.go:117] "RemoveContainer" containerID="6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377" Jul 06 22:31:07.243504 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.243490 2568 scope.go:117] "RemoveContainer" containerID="6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377" Jul 06 22:31:07.243767 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:31:07.243749 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377\": container with ID starting with 6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377 not found: ID does not exist" containerID="6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377" Jul 06 22:31:07.243823 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.243776 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377"} err="failed to get container status \"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377\": rpc error: code = NotFound desc = could not find container \"6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377\": container with ID starting with 6f22d114ef4d6347cc766b95e29df99ac2ecc46756004f555ed6e4f8273b3377 not found: ID does not exist" Jul 06 22:31:07.271142 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.271119 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:07.277631 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:07.277612 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9jj7h"] Jul 06 22:31:09.025457 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:09.025428 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" path="/var/lib/kubelet/pods/00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd/volumes" Jul 06 22:31:10.547032 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:10.546984 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:10.647950 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:10.647922 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:14.023319 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:14.023282 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:14.023793 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:14.023333 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:14.047484 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:14.047450 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:14.293443 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:14.293381 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n7j4f" Jul 06 22:31:18.767075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.767004 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9"] Jul 06 22:31:18.767428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.767415 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" containerName="registry-server" Jul 06 22:31:18.767428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.767429 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" containerName="registry-server" Jul 06 22:31:18.767510 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.767503 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b5cbf8-6d3d-4137-958a-ecd5cb3a69dd" containerName="registry-server" Jul 06 22:31:18.770738 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.770700 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.773635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.773617 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n9m9x\"" Jul 06 22:31:18.780862 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.780837 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9"] Jul 06 22:31:18.849470 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.849447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.849607 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.849479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkz8c\" (UniqueName: \"kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.849607 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.849505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.950634 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.950610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.950750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.950679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.950750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.950729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkz8c\" (UniqueName: \"kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.951013 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.950993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.951106 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.951088 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:18.960236 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:18.960210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkz8c\" (UniqueName: \"kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:19.081303 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.081250 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:19.221554 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.221522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9"] Jul 06 22:31:19.227432 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:19.227399 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa121bc4_6801_4a41_a7ea_f88768a3f28b.slice/crio-cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017 WatchSource:0}: Error finding container cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017: Status 404 returned error can't find the container with id cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017 Jul 06 22:31:19.297195 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.297170 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerStarted","Data":"d736446f5a7de0a3cd4dae57cd76bc9aedb42efb5a1dad664016e79fcae44d88"} Jul 06 22:31:19.297292 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.297212 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerStarted","Data":"cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017"} Jul 06 22:31:19.371113 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.371088 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs"] Jul 06 22:31:19.374630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.374614 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.386917 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.386891 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs"] Jul 06 22:31:19.454605 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.454573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.454752 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.454611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.454824 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.454787 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4btt\" (UniqueName: \"kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.555660 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.555634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.555804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.555667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.555804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.555772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4btt\" (UniqueName: \"kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.556002 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.555978 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.556072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.556027 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.564353 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.564330 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4btt\" (UniqueName: \"kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.683284 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.683220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:19.820470 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.820447 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs"] Jul 06 22:31:19.822640 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:19.822614 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8adab5_0234_47ce_9713_0282f713eb53.slice/crio-8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00 WatchSource:0}: Error finding container 8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00: Status 404 returned error can't find the container with id 8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00 Jul 06 22:31:19.954365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.954309 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd"] Jul 06 22:31:19.957969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.957953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:19.966409 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:19.966383 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd"] Jul 06 22:31:20.061668 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.061648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.061793 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.061695 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9s8\" (UniqueName: \"kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.061793 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.061781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.163086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.163063 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9s8\" (UniqueName: \"kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.163184 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.163110 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.163184 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.163158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.163532 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.163512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.163580 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.163533 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.176547 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.176525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9s8\" (UniqueName: \"kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.300749 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.300732 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:20.309696 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.309672 2568 generic.go:356] "Generic (PLEG): container finished" podID="3b8adab5-0234-47ce-9713-0282f713eb53" containerID="9e848ad54284ef5f060b9d5006d7748ce484d268af4ceaaa9fa428d7cbf0067e" exitCode=0 Jul 06 22:31:20.309811 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.309763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" event={"ID":"3b8adab5-0234-47ce-9713-0282f713eb53","Type":"ContainerDied","Data":"9e848ad54284ef5f060b9d5006d7748ce484d268af4ceaaa9fa428d7cbf0067e"} Jul 06 22:31:20.309872 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.309858 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" event={"ID":"3b8adab5-0234-47ce-9713-0282f713eb53","Type":"ContainerStarted","Data":"8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00"} Jul 06 22:31:20.311905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.311869 2568 generic.go:356] "Generic (PLEG): container finished" podID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerID="d736446f5a7de0a3cd4dae57cd76bc9aedb42efb5a1dad664016e79fcae44d88" exitCode=0 Jul 06 22:31:20.311905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.311925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerDied","Data":"d736446f5a7de0a3cd4dae57cd76bc9aedb42efb5a1dad664016e79fcae44d88"} Jul 06 22:31:20.365914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.365848 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9"] Jul 06 22:31:20.370991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.370971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.379987 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.379949 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9"] Jul 06 22:31:20.444954 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.444933 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd"] Jul 06 22:31:20.447055 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:20.447026 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf87dab_5132_4e9f_a3e1_d155f5bca166.slice/crio-846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd WatchSource:0}: Error finding container 846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd: Status 404 returned error can't find the container with id 846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd Jul 06 22:31:20.466767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.466740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.466865 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.466782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.466930 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.466883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzqr7\" (UniqueName: \"kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.567883 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.567824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.567883 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.567857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.568012 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.567904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqr7\" (UniqueName: \"kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.568181 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.568163 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.568263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.568245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.576833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.576812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzqr7\" (UniqueName: \"kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.681439 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.681419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:20.834654 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:20.834630 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9"] Jul 06 22:31:20.890355 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:20.890315 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a493ef3_e541_4de8_8c4d_fba9bf82e8f8.slice/crio-6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554 WatchSource:0}: Error finding container 6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554: Status 404 returned error can't find the container with id 6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554 Jul 06 22:31:21.318903 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.318866 2568 generic.go:356] "Generic (PLEG): container finished" podID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerID="3f3bc474870ed0298c90133d7a8fc6dd523885ad04024464d877c3f504600ff1" exitCode=0 Jul 06 22:31:21.319018 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.318944 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerDied","Data":"3f3bc474870ed0298c90133d7a8fc6dd523885ad04024464d877c3f504600ff1"} Jul 06 22:31:21.321145 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.321123 2568 generic.go:356] "Generic (PLEG): container finished" podID="3b8adab5-0234-47ce-9713-0282f713eb53" containerID="c4aba7fb42e971752c318aeb87f1c67b38b08fa0f8f96cc7132fdfce63182af9" exitCode=0 Jul 06 22:31:21.321252 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.321209 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" event={"ID":"3b8adab5-0234-47ce-9713-0282f713eb53","Type":"ContainerDied","Data":"c4aba7fb42e971752c318aeb87f1c67b38b08fa0f8f96cc7132fdfce63182af9"} Jul 06 22:31:21.323612 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.323593 2568 generic.go:356] "Generic (PLEG): container finished" podID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerID="f7ec1253e3b772cd959f75b94293cf71683f94f500544163a04b2acf9ac4048a" exitCode=0 Jul 06 22:31:21.323703 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.323661 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" event={"ID":"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8","Type":"ContainerDied","Data":"f7ec1253e3b772cd959f75b94293cf71683f94f500544163a04b2acf9ac4048a"} Jul 06 22:31:21.323703 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.323695 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" event={"ID":"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8","Type":"ContainerStarted","Data":"6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554"} Jul 06 22:31:21.325265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.325243 2568 generic.go:356] "Generic (PLEG): container finished" podID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerID="ec00adcb4beed06af4ca1cb2e2106048a6ed0b5f188d90b180999487eefb4d5b" exitCode=0 Jul 06 22:31:21.325420 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.325277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" event={"ID":"4cf87dab-5132-4e9f-a3e1-d155f5bca166","Type":"ContainerDied","Data":"ec00adcb4beed06af4ca1cb2e2106048a6ed0b5f188d90b180999487eefb4d5b"} Jul 06 22:31:21.325420 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:21.325334 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" event={"ID":"4cf87dab-5132-4e9f-a3e1-d155f5bca166","Type":"ContainerStarted","Data":"846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd"} Jul 06 22:31:22.332682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.332653 2568 generic.go:356] "Generic (PLEG): container finished" podID="3b8adab5-0234-47ce-9713-0282f713eb53" containerID="bcf5ea40aeade478919bed8185fe9ad56a99f911f236522d47292b51ccf57ea5" exitCode=0 Jul 06 22:31:22.333090 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.332740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" event={"ID":"3b8adab5-0234-47ce-9713-0282f713eb53","Type":"ContainerDied","Data":"bcf5ea40aeade478919bed8185fe9ad56a99f911f236522d47292b51ccf57ea5"} Jul 06 22:31:22.334462 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.334439 2568 generic.go:356] "Generic (PLEG): container finished" podID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerID="d9b1220d308df26e37c216e63d5856e86512df78c3143f21c6af39885025309d" exitCode=0 Jul 06 22:31:22.334569 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.334466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" event={"ID":"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8","Type":"ContainerDied","Data":"d9b1220d308df26e37c216e63d5856e86512df78c3143f21c6af39885025309d"} Jul 06 22:31:22.336324 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.336303 2568 generic.go:356] "Generic (PLEG): container finished" podID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerID="aba710364644d2136d9b4604bd0b100dda7620c4480cf4cff5bb4a8ed1f26d69" exitCode=0 Jul 06 22:31:22.336432 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.336394 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" event={"ID":"4cf87dab-5132-4e9f-a3e1-d155f5bca166","Type":"ContainerDied","Data":"aba710364644d2136d9b4604bd0b100dda7620c4480cf4cff5bb4a8ed1f26d69"} Jul 06 22:31:22.338574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.338555 2568 generic.go:356] "Generic (PLEG): container finished" podID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerID="0cc42b7345f063ed93ddd3533276489b79698cd78bb2730335b966b6c075ab28" exitCode=0 Jul 06 22:31:22.338654 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:22.338596 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerDied","Data":"0cc42b7345f063ed93ddd3533276489b79698cd78bb2730335b966b6c075ab28"} Jul 06 22:31:23.346507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.346479 2568 generic.go:356] "Generic (PLEG): container finished" podID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerID="531ba8b669d62a888852708daf4d2906b96618c4e120e4330c594300b22e079b" exitCode=0 Jul 06 22:31:23.346962 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.346545 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" event={"ID":"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8","Type":"ContainerDied","Data":"531ba8b669d62a888852708daf4d2906b96618c4e120e4330c594300b22e079b"} Jul 06 22:31:23.348556 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.348524 2568 generic.go:356] "Generic (PLEG): container finished" podID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerID="8f98ad7bc4721c3848821138531ba5dd9c12929ce5c02de17d4adb8f63835657" exitCode=0 Jul 06 22:31:23.348676 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.348608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" event={"ID":"4cf87dab-5132-4e9f-a3e1-d155f5bca166","Type":"ContainerDied","Data":"8f98ad7bc4721c3848821138531ba5dd9c12929ce5c02de17d4adb8f63835657"} Jul 06 22:31:23.491031 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.491009 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:23.524179 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.524154 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:23.594698 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.594674 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util\") pod \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " Jul 06 22:31:23.594849 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.594758 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkz8c\" (UniqueName: \"kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c\") pod \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " Jul 06 22:31:23.594849 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.594800 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle\") pod \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\" (UID: \"aa121bc4-6801-4a41-a7ea-f88768a3f28b\") " Jul 06 22:31:23.595317 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.595289 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle" (OuterVolumeSpecName: "bundle") pod "aa121bc4-6801-4a41-a7ea-f88768a3f28b" (UID: "aa121bc4-6801-4a41-a7ea-f88768a3f28b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:23.596799 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.596746 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c" (OuterVolumeSpecName: "kube-api-access-kkz8c") pod "aa121bc4-6801-4a41-a7ea-f88768a3f28b" (UID: "aa121bc4-6801-4a41-a7ea-f88768a3f28b"). InnerVolumeSpecName "kube-api-access-kkz8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:31:23.600145 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.600107 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util" (OuterVolumeSpecName: "util") pod "aa121bc4-6801-4a41-a7ea-f88768a3f28b" (UID: "aa121bc4-6801-4a41-a7ea-f88768a3f28b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:23.696169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696135 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util\") pod \"3b8adab5-0234-47ce-9713-0282f713eb53\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " Jul 06 22:31:23.696252 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle\") pod \"3b8adab5-0234-47ce-9713-0282f713eb53\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " Jul 06 22:31:23.696297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696254 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4btt\" (UniqueName: \"kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt\") pod \"3b8adab5-0234-47ce-9713-0282f713eb53\" (UID: \"3b8adab5-0234-47ce-9713-0282f713eb53\") " Jul 06 22:31:23.696422 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696410 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkz8c\" (UniqueName: \"kubernetes.io/projected/aa121bc4-6801-4a41-a7ea-f88768a3f28b-kube-api-access-kkz8c\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:23.696464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696424 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:23.696464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696432 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa121bc4-6801-4a41-a7ea-f88768a3f28b-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:23.696648 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.696617 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle" (OuterVolumeSpecName: "bundle") pod "3b8adab5-0234-47ce-9713-0282f713eb53" (UID: "3b8adab5-0234-47ce-9713-0282f713eb53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:23.698146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.698125 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt" (OuterVolumeSpecName: "kube-api-access-s4btt") pod "3b8adab5-0234-47ce-9713-0282f713eb53" (UID: "3b8adab5-0234-47ce-9713-0282f713eb53"). InnerVolumeSpecName "kube-api-access-s4btt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:31:23.701634 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.701614 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util" (OuterVolumeSpecName: "util") pod "3b8adab5-0234-47ce-9713-0282f713eb53" (UID: "3b8adab5-0234-47ce-9713-0282f713eb53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:23.797179 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.797158 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:23.797179 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.797180 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b8adab5-0234-47ce-9713-0282f713eb53-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:23.797294 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:23.797189 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4btt\" (UniqueName: \"kubernetes.io/projected/3b8adab5-0234-47ce-9713-0282f713eb53-kube-api-access-s4btt\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.356274 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.356253 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" Jul 06 22:31:24.356680 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.356293 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs" event={"ID":"3b8adab5-0234-47ce-9713-0282f713eb53","Type":"ContainerDied","Data":"8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00"} Jul 06 22:31:24.356680 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.356335 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a1fbd35158e230b43cede5aa002c4bf062b7dd6752eb27e8547c4017b4e6e00" Jul 06 22:31:24.358276 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.358250 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" Jul 06 22:31:24.358414 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.358278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9" event={"ID":"aa121bc4-6801-4a41-a7ea-f88768a3f28b","Type":"ContainerDied","Data":"cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017"} Jul 06 22:31:24.358414 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.358317 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cddceaf1b8af2be9ba70d677b3a91b9fd8a4de650d17de228ee2d8addabb4017" Jul 06 22:31:24.493329 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.493307 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:24.521307 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.521284 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:24.604142 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.604109 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle\") pod \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " Jul 06 22:31:24.604282 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.604164 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util\") pod \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " Jul 06 22:31:24.604282 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.604195 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzqr7\" (UniqueName: \"kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7\") pod \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\" (UID: \"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8\") " Jul 06 22:31:24.604876 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.604836 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle" (OuterVolumeSpecName: "bundle") pod "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" (UID: "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:24.606160 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.606140 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7" (OuterVolumeSpecName: "kube-api-access-fzqr7") pod "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" (UID: "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8"). InnerVolumeSpecName "kube-api-access-fzqr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:31:24.610128 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.610084 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util" (OuterVolumeSpecName: "util") pod "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" (UID: "8a493ef3-e541-4de8-8c4d-fba9bf82e8f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:24.705038 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705005 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k9s8\" (UniqueName: \"kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8\") pod \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " Jul 06 22:31:24.705162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705065 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util\") pod \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " Jul 06 22:31:24.705162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705090 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle\") pod \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\" (UID: \"4cf87dab-5132-4e9f-a3e1-d155f5bca166\") " Jul 06 22:31:24.705394 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705376 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.705452 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705398 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.705452 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705411 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzqr7\" (UniqueName: \"kubernetes.io/projected/8a493ef3-e541-4de8-8c4d-fba9bf82e8f8-kube-api-access-fzqr7\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.705534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.705506 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle" (OuterVolumeSpecName: "bundle") pod "4cf87dab-5132-4e9f-a3e1-d155f5bca166" (UID: "4cf87dab-5132-4e9f-a3e1-d155f5bca166"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:24.706991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.706969 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8" (OuterVolumeSpecName: "kube-api-access-4k9s8") pod "4cf87dab-5132-4e9f-a3e1-d155f5bca166" (UID: "4cf87dab-5132-4e9f-a3e1-d155f5bca166"). InnerVolumeSpecName "kube-api-access-4k9s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:31:24.710790 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.710770 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util" (OuterVolumeSpecName: "util") pod "4cf87dab-5132-4e9f-a3e1-d155f5bca166" (UID: "4cf87dab-5132-4e9f-a3e1-d155f5bca166"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:31:24.806510 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.806477 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k9s8\" (UniqueName: \"kubernetes.io/projected/4cf87dab-5132-4e9f-a3e1-d155f5bca166-kube-api-access-4k9s8\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.806510 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.806509 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-util\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:24.806669 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:24.806524 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cf87dab-5132-4e9f-a3e1-d155f5bca166-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:31:25.365164 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.365131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" event={"ID":"8a493ef3-e541-4de8-8c4d-fba9bf82e8f8","Type":"ContainerDied","Data":"6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554"} Jul 06 22:31:25.365164 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.365152 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9" Jul 06 22:31:25.365606 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.365206 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c404ad14bddf86d6420cdd0d793c17fb55e24560125876be43d1c546cd4b554" Jul 06 22:31:25.367345 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.367319 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" event={"ID":"4cf87dab-5132-4e9f-a3e1-d155f5bca166","Type":"ContainerDied","Data":"846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd"} Jul 06 22:31:25.367468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.367366 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="846e5029df3202e6382f97c8e1296b2d21ffaaeb2ef9dd19e524c08bb3cf52cd" Jul 06 22:31:25.367468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:25.367330 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd" Jul 06 22:31:27.124656 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:27.124629 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:29.773844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.773816 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr"] Jul 06 22:31:29.774201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774164 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="util" Jul 06 22:31:29.774201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774175 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="util" Jul 06 22:31:29.774201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774189 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="extract" Jul 06 22:31:29.774201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774194 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="extract" Jul 06 22:31:29.774201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774202 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774208 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774215 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774220 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774227 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774232 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774240 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774245 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774253 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774258 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774264 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774268 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="extract" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774282 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774287 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774295 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774300 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="util" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774306 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774311 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774317 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774322 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="pull" Jul 06 22:31:29.774373 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774375 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8adab5-0234-47ce-9713-0282f713eb53" containerName="extract" Jul 06 22:31:29.774953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774384 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a493ef3-e541-4de8-8c4d-fba9bf82e8f8" containerName="extract" Jul 06 22:31:29.774953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774389 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf87dab-5132-4e9f-a3e1-d155f5bca166" containerName="extract" Jul 06 22:31:29.774953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.774395 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa121bc4-6801-4a41-a7ea-f88768a3f28b" containerName="extract" Jul 06 22:31:29.778321 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.778307 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:29.782647 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.782629 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-26tnq\"" Jul 06 22:31:29.783309 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.783294 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 22:31:29.808801 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.808781 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr"] Jul 06 22:31:29.842229 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.842205 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqqs\" (UniqueName: \"kubernetes.io/projected/a07c6877-e086-4358-9dc1-2ccda2350cfa-kube-api-access-bhqqs\") pod \"dns-operator-controller-manager-864dd78c4c-tv5kr\" (UID: \"a07c6877-e086-4358-9dc1-2ccda2350cfa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:29.943454 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.943429 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqqs\" (UniqueName: \"kubernetes.io/projected/a07c6877-e086-4358-9dc1-2ccda2350cfa-kube-api-access-bhqqs\") pod \"dns-operator-controller-manager-864dd78c4c-tv5kr\" (UID: \"a07c6877-e086-4358-9dc1-2ccda2350cfa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:29.955024 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:29.955000 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqqs\" (UniqueName: \"kubernetes.io/projected/a07c6877-e086-4358-9dc1-2ccda2350cfa-kube-api-access-bhqqs\") pod \"dns-operator-controller-manager-864dd78c4c-tv5kr\" (UID: \"a07c6877-e086-4358-9dc1-2ccda2350cfa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:30.088041 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:30.087983 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:30.231815 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:30.231790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr"] Jul 06 22:31:30.233930 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:30.233903 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07c6877_e086_4358_9dc1_2ccda2350cfa.slice/crio-9f3b32514be17bfff1b36389830036a8bc12458a9b87739715d8b4c2c0c11085 WatchSource:0}: Error finding container 9f3b32514be17bfff1b36389830036a8bc12458a9b87739715d8b4c2c0c11085: Status 404 returned error can't find the container with id 9f3b32514be17bfff1b36389830036a8bc12458a9b87739715d8b4c2c0c11085 Jul 06 22:31:30.394152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:30.394084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" event={"ID":"a07c6877-e086-4358-9dc1-2ccda2350cfa","Type":"ContainerStarted","Data":"9f3b32514be17bfff1b36389830036a8bc12458a9b87739715d8b4c2c0c11085"} Jul 06 22:31:30.612084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:30.612050 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:31.359888 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:31.359850 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:32.406926 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:32.406894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" event={"ID":"a07c6877-e086-4358-9dc1-2ccda2350cfa","Type":"ContainerStarted","Data":"0f10850610f3fe14d72ecb1d54f1d905168b2eeda99cbf8309c91fc266948cab"} Jul 06 22:31:32.407265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:32.406948 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:32.424106 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:32.424064 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" podStartSLOduration=1.723978512 podStartE2EDuration="3.424049534s" totalImagesPullingTime="1.700071022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:32.423040785 +0000 UTC m=+459.846927485" watchObservedRunningTime="2026-07-06 22:31:32.424049534 +0000 UTC m=+459.847936231" Jul 06 22:31:35.007581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:35.007425 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:35.277507 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:35.277426 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:37.292845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.292816 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:37.657039 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.656965 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4"] Jul 06 22:31:37.661028 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.661010 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:37.665571 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.665550 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-txg9r\"" Jul 06 22:31:37.674563 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.674537 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4"] Jul 06 22:31:37.692299 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.692274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2729\" (UniqueName: \"kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729\") pod \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" (UID: \"51531a54-0555-497d-a495-035b05d22bf6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:37.793441 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.793414 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2729\" (UniqueName: \"kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729\") pod \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" (UID: \"51531a54-0555-497d-a495-035b05d22bf6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:37.805258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.805237 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2729\" (UniqueName: \"kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729\") pod \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" (UID: \"51531a54-0555-497d-a495-035b05d22bf6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:37.906420 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.906393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:37.971365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:37.971311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:38.122260 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:38.122233 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4"] Jul 06 22:31:38.123788 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:38.123759 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51531a54_0555_497d_a495_035b05d22bf6.slice/crio-8563d0c441c1c34c20f45f414d27161c4b08eb58eeff17c9329af14e0daf5ec9 WatchSource:0}: Error finding container 8563d0c441c1c34c20f45f414d27161c4b08eb58eeff17c9329af14e0daf5ec9: Status 404 returned error can't find the container with id 8563d0c441c1c34c20f45f414d27161c4b08eb58eeff17c9329af14e0daf5ec9 Jul 06 22:31:38.360087 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:38.360061 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:38.439922 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:38.439894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" event={"ID":"51531a54-0555-497d-a495-035b05d22bf6","Type":"ContainerStarted","Data":"8563d0c441c1c34c20f45f414d27161c4b08eb58eeff17c9329af14e0daf5ec9"} Jul 06 22:31:39.959773 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:39.959745 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:40.453447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:40.453411 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" event={"ID":"51531a54-0555-497d-a495-035b05d22bf6","Type":"ContainerStarted","Data":"d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f"} Jul 06 22:31:40.453647 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:40.453564 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:40.471277 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:40.471236 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" podStartSLOduration=2.128840277 podStartE2EDuration="3.471222026s" totalImagesPullingTime="1.342381749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:40.470601925 +0000 UTC m=+467.894488627" watchObservedRunningTime="2026-07-06 22:31:40.471222026 +0000 UTC m=+467.895108725" Jul 06 22:31:43.145549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:43.145517 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:43.286838 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:43.286809 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:43.414757 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:43.414667 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tv5kr" Jul 06 22:31:45.562495 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.562459 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b78d55597-phf49"] Jul 06 22:31:45.566598 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.566577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.581835 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.581814 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78d55597-phf49"] Jul 06 22:31:45.626633 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.626605 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:45.649918 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.649889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650038 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.649924 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-console-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650038 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.649974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-service-ca\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650038 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.650005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-oauth-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650207 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.650066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-trusted-ca-bundle\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650207 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.650096 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-oauth-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.650207 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.650125 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x57w9\" (UniqueName: \"kubernetes.io/projected/15afc2cd-211c-4109-ab04-55dc987c6108-kube-api-access-x57w9\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.729951 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.729919 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:45.750862 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.750839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.750939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.750868 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-console-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.750939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.750907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-service-ca\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.750939 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.750935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-oauth-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.750976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-trusted-ca-bundle\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-oauth-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751072 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x57w9\" (UniqueName: \"kubernetes.io/projected/15afc2cd-211c-4109-ab04-55dc987c6108-kube-api-access-x57w9\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751727 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751687 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-console-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751687 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-service-ca\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751813 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-oauth-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.751970 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.751880 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15afc2cd-211c-4109-ab04-55dc987c6108-trusted-ca-bundle\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.753251 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.753230 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-serving-cert\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.753364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.753343 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15afc2cd-211c-4109-ab04-55dc987c6108-console-oauth-config\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.762612 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.762591 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x57w9\" (UniqueName: \"kubernetes.io/projected/15afc2cd-211c-4109-ab04-55dc987c6108-kube-api-access-x57w9\") pod \"console-6b78d55597-phf49\" (UID: \"15afc2cd-211c-4109-ab04-55dc987c6108\") " pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:45.870785 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.869362 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:45.877109 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:45.877078 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:46.032453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.032427 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b78d55597-phf49"] Jul 06 22:31:46.034590 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:46.034567 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15afc2cd_211c_4109_ab04_55dc987c6108.slice/crio-4b95e38f3e9f0ad1ef6696c65ca280a3633f6a78d39237093f736110a7d75925 WatchSource:0}: Error finding container 4b95e38f3e9f0ad1ef6696c65ca280a3633f6a78d39237093f736110a7d75925: Status 404 returned error can't find the container with id 4b95e38f3e9f0ad1ef6696c65ca280a3633f6a78d39237093f736110a7d75925 Jul 06 22:31:46.354993 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.354962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.455695 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.455666 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.491385 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.491357 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d55597-phf49" event={"ID":"15afc2cd-211c-4109-ab04-55dc987c6108","Type":"ContainerStarted","Data":"da6952c18cf03207ccd8571b708928586696b2cded075f08859922da0afabdc3"} Jul 06 22:31:46.491496 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.491403 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b78d55597-phf49" event={"ID":"15afc2cd-211c-4109-ab04-55dc987c6108","Type":"ContainerStarted","Data":"4b95e38f3e9f0ad1ef6696c65ca280a3633f6a78d39237093f736110a7d75925"} Jul 06 22:31:46.514123 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:46.514073 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b78d55597-phf49" podStartSLOduration=1.514058898 podStartE2EDuration="1.514058898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:46.512383758 +0000 UTC m=+473.936270459" watchObservedRunningTime="2026-07-06 22:31:46.514058898 +0000 UTC m=+473.937945597" Jul 06 22:31:48.517032 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:48.517006 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:48.620046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:48.620021 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:48.946185 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:48.946110 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:49.137949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:49.137918 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:50.290967 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.290935 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s"] Jul 06 22:31:50.294525 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.294508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.296197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.296171 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:50.297054 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.297035 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 22:31:50.297054 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.297043 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n9m9x\"" Jul 06 22:31:50.297266 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.297253 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 22:31:50.306230 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.306211 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s"] Jul 06 22:31:50.388955 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.388931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ftq\" (UniqueName: \"kubernetes.io/projected/99254afe-0db6-42f8-b546-a44d4916cc6d-kube-api-access-z7ftq\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.389057 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.389012 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99254afe-0db6-42f8-b546-a44d4916cc6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.389057 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.389034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99254afe-0db6-42f8-b546-a44d4916cc6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.489539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.489515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ftq\" (UniqueName: \"kubernetes.io/projected/99254afe-0db6-42f8-b546-a44d4916cc6d-kube-api-access-z7ftq\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.489659 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.489585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99254afe-0db6-42f8-b546-a44d4916cc6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.489659 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.489604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99254afe-0db6-42f8-b546-a44d4916cc6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.490149 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.490132 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99254afe-0db6-42f8-b546-a44d4916cc6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.492008 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.491984 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99254afe-0db6-42f8-b546-a44d4916cc6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.497867 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.497843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ftq\" (UniqueName: \"kubernetes.io/projected/99254afe-0db6-42f8-b546-a44d4916cc6d-kube-api-access-z7ftq\") pod \"kuadrant-console-plugin-66b5774985-xmb6s\" (UID: \"99254afe-0db6-42f8-b546-a44d4916cc6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.513457 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.513436 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:50.605218 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.605151 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" Jul 06 22:31:50.743066 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:50.743045 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s"] Jul 06 22:31:50.744281 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:31:50.744253 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99254afe_0db6_42f8_b546_a44d4916cc6d.slice/crio-c880d8eed6fbc5ed5c2155991fd46be8c0e683bf022a31205e13627a0cbffacb WatchSource:0}: Error finding container c880d8eed6fbc5ed5c2155991fd46be8c0e683bf022a31205e13627a0cbffacb: Status 404 returned error can't find the container with id c880d8eed6fbc5ed5c2155991fd46be8c0e683bf022a31205e13627a0cbffacb Jul 06 22:31:51.461731 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:51.461600 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:31:51.468998 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:51.468970 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:51.530393 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:51.530325 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" event={"ID":"99254afe-0db6-42f8-b546-a44d4916cc6d","Type":"ContainerStarted","Data":"c880d8eed6fbc5ed5c2155991fd46be8c0e683bf022a31205e13627a0cbffacb"} Jul 06 22:31:52.402298 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:52.402229 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:52.501526 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:52.501487 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:54.901767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:54.901669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:54.972291 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:54.972255 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:55.877960 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:55.877926 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:55.878119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:55.877979 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:55.883250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:55.883227 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:56.573928 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:56.573898 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b78d55597-phf49" Jul 06 22:31:56.650671 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:56.650639 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:31:56.845767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:56.845669 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:56.961988 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:31:56.961942 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:00.081836 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.081809 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq"] Jul 06 22:32:00.101470 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.101443 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq"] Jul 06 22:32:00.101649 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.101557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.104444 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.104424 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bzlzn\"" Jul 06 22:32:00.185265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.185233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6fq2\" (UniqueName: \"kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.185403 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.185284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.286115 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.286087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6fq2\" (UniqueName: \"kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.286268 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.286131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.286538 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.286518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.294660 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.294635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6fq2\" (UniqueName: \"kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.413910 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.413840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:00.851006 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.850972 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq"] Jul 06 22:32:00.854419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.854392 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq"] Jul 06 22:32:00.878263 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.878234 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:00.889214 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.889185 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:00.894633 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.894610 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4"] Jul 06 22:32:00.895197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.895166 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" podUID="51531a54-0555-497d-a495-035b05d22bf6" containerName="manager" containerID="cri-o://d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f" gracePeriod=2 Jul 06 22:32:00.899768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.899748 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:00.909889 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.909868 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4"] Jul 06 22:32:00.931923 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:00.931885 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:00.938030 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.938008 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f"] Jul 06 22:32:00.938655 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.938632 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51531a54-0555-497d-a495-035b05d22bf6" containerName="manager" Jul 06 22:32:00.938655 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.938655 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="51531a54-0555-497d-a495-035b05d22bf6" containerName="manager" Jul 06 22:32:00.938855 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.938824 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="51531a54-0555-497d-a495-035b05d22bf6" containerName="manager" Jul 06 22:32:00.944267 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.944216 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:00.946861 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:00.946805 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:00.952928 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.952909 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f"] Jul 06 22:32:00.994519 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.994481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzbmg\" (UniqueName: \"kubernetes.io/projected/4b036617-a4b4-4fcb-acf4-6ddcba99716b-kube-api-access-jzbmg\") pod \"limitador-operator-controller-manager-859d7b78bd-m257f\" (UID: \"4b036617-a4b4-4fcb-acf4-6ddcba99716b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:00.994645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.994569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:00.994700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:00.994686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfc4d\" (UniqueName: \"kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.096306 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.096257 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.096750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.096401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfc4d\" (UniqueName: \"kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.096750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.096527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzbmg\" (UniqueName: \"kubernetes.io/projected/4b036617-a4b4-4fcb-acf4-6ddcba99716b-kube-api-access-jzbmg\") pod \"limitador-operator-controller-manager-859d7b78bd-m257f\" (UID: \"4b036617-a4b4-4fcb-acf4-6ddcba99716b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:01.096750 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.096669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.106609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.106538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfc4d\" (UniqueName: \"kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cfd2r\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.106768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.106676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzbmg\" (UniqueName: \"kubernetes.io/projected/4b036617-a4b4-4fcb-acf4-6ddcba99716b-kube-api-access-jzbmg\") pod \"limitador-operator-controller-manager-859d7b78bd-m257f\" (UID: \"4b036617-a4b4-4fcb-acf4-6ddcba99716b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:01.212005 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.211972 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:01.270964 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.270937 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:01.560239 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.560206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:01.662522 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:01.662479 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.892940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:06.892911 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.993593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:06.993550 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:07.297528 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:07.297491 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:07.395612 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:07.395575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:10.693835 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:10.693801 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:10.796955 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:10.796929 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:12.434201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.433978 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:12.437926 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:12.437893 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:12.481042 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.480984 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f"] Jul 06 22:32:12.483759 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:32:12.483732 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b036617_a4b4_4fcb_acf4_6ddcba99716b.slice/crio-d63de379b7f48481c6fba45c4c1add0bc4aef615f6354df05495aae00b61f09d WatchSource:0}: Error finding container d63de379b7f48481c6fba45c4c1add0bc4aef615f6354df05495aae00b61f09d: Status 404 returned error can't find the container with id d63de379b7f48481c6fba45c4c1add0bc4aef615f6354df05495aae00b61f09d Jul 06 22:32:12.495929 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.495906 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:12.498682 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:32:12.498657 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84abebce_f753_43d8_aad8_faf270bde4b7.slice/crio-17042ec437848028570c1d63b40d85c9dc8ce266d2fdca5c7026a66f84e05bcc WatchSource:0}: Error finding container 17042ec437848028570c1d63b40d85c9dc8ce266d2fdca5c7026a66f84e05bcc: Status 404 returned error can't find the container with id 17042ec437848028570c1d63b40d85c9dc8ce266d2fdca5c7026a66f84e05bcc Jul 06 22:32:12.605869 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.605843 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2729\" (UniqueName: \"kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729\") pod \"51531a54-0555-497d-a495-035b05d22bf6\" (UID: \"51531a54-0555-497d-a495-035b05d22bf6\") " Jul 06 22:32:12.607621 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.607599 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729" (OuterVolumeSpecName: "kube-api-access-q2729") pod "51531a54-0555-497d-a495-035b05d22bf6" (UID: "51531a54-0555-497d-a495-035b05d22bf6"). InnerVolumeSpecName "kube-api-access-q2729". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:12.673523 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.673491 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" event={"ID":"99254afe-0db6-42f8-b546-a44d4916cc6d","Type":"ContainerStarted","Data":"20795f067fa30596b3977c32e5135f277f705cb99c2cf30f86606b16d67c0d5a"} Jul 06 22:32:12.675059 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.675032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" event={"ID":"4b036617-a4b4-4fcb-acf4-6ddcba99716b","Type":"ContainerStarted","Data":"9da9f0b45e343bde8e7a1b191a99296ad377dfd989238fc0873c5ba5295be478"} Jul 06 22:32:12.675169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.675080 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" event={"ID":"4b036617-a4b4-4fcb-acf4-6ddcba99716b","Type":"ContainerStarted","Data":"d63de379b7f48481c6fba45c4c1add0bc4aef615f6354df05495aae00b61f09d"} Jul 06 22:32:12.675169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.675110 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:12.676354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.676333 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" event={"ID":"84abebce-f753-43d8-aad8-faf270bde4b7","Type":"ContainerStarted","Data":"17042ec437848028570c1d63b40d85c9dc8ce266d2fdca5c7026a66f84e05bcc"} Jul 06 22:32:12.677575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.677554 2568 generic.go:356] "Generic (PLEG): container finished" podID="51531a54-0555-497d-a495-035b05d22bf6" containerID="d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f" exitCode=0 Jul 06 22:32:12.677667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.677587 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:12.677667 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.677593 2568 scope.go:117] "RemoveContainer" containerID="d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f" Jul 06 22:32:12.683230 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:12.683155 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:12.693283 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.693264 2568 scope.go:117] "RemoveContainer" containerID="d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f" Jul 06 22:32:12.693554 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:12.693532 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f\": container with ID starting with d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f not found: ID does not exist" containerID="d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f" Jul 06 22:32:12.693639 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.693559 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f"} err="failed to get container status \"d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f\": rpc error: code = NotFound desc = could not find container \"d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f\": container with ID starting with d4d20b038c05d7723955bded0fed3dfe92db939cbc256398f6fad08293a4db2f not found: ID does not exist" Jul 06 22:32:12.707085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.707062 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2729\" (UniqueName: \"kubernetes.io/projected/51531a54-0555-497d-a495-035b05d22bf6-kube-api-access-q2729\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:12.720064 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:12.720039 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:12.720371 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.720336 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xmb6s" podStartSLOduration=1.100341043 podStartE2EDuration="22.720323836s" totalImagesPullingTime="21.619982793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:12.717806305 +0000 UTC m=+500.141693005" watchObservedRunningTime="2026-07-06 22:32:12.720323836 +0000 UTC m=+500.144210550" Jul 06 22:32:12.759591 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:12.759540 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" podStartSLOduration=12.759522437 podStartE2EDuration="12.759522437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:12.757652917 +0000 UTC m=+500.181539617" watchObservedRunningTime="2026-07-06 22:32:12.759522437 +0000 UTC m=+500.183409142" Jul 06 22:32:13.025949 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:13.025909 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mqkz4\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="51531a54-0555-497d-a495-035b05d22bf6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mqkz4" Jul 06 22:32:13.027724 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:13.027686 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51531a54-0555-497d-a495-035b05d22bf6" path="/var/lib/kubelet/pods/51531a54-0555-497d-a495-035b05d22bf6/volumes" Jul 06 22:32:13.286484 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:13.286460 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:13.387251 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:13.387223 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:14.856884 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:14.856841 2568 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-f8bmq_kuadrant-system_a30cca44-b76f-4f8a-ba10-ecdaf6d33222_0(264e1f55d76b10be43ed2bb52fcbb6276320d25a3a55a07af659f080a8497e9c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-f8bmq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 06 22:32:14.857279 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:14.856916 2568 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-f8bmq_kuadrant-system_a30cca44-b76f-4f8a-ba10-ecdaf6d33222_0(264e1f55d76b10be43ed2bb52fcbb6276320d25a3a55a07af659f080a8497e9c): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-f8bmq to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:15.702976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.702947 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:15.705238 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:15.705203 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="a30cca44-b76f-4f8a-ba10-ecdaf6d33222" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:15.709991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.709964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:15.712260 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:15.712234 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="a30cca44-b76f-4f8a-ba10-ecdaf6d33222" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:15.836051 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.836011 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6fq2\" (UniqueName: \"kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2\") pod \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " Jul 06 22:32:15.836219 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.836066 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume\") pod \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\" (UID: \"a30cca44-b76f-4f8a-ba10-ecdaf6d33222\") " Jul 06 22:32:15.836808 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.836487 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a30cca44-b76f-4f8a-ba10-ecdaf6d33222" (UID: "a30cca44-b76f-4f8a-ba10-ecdaf6d33222"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:15.838725 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.838686 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2" (OuterVolumeSpecName: "kube-api-access-n6fq2") pod "a30cca44-b76f-4f8a-ba10-ecdaf6d33222" (UID: "a30cca44-b76f-4f8a-ba10-ecdaf6d33222"). InnerVolumeSpecName "kube-api-access-n6fq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:15.937520 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.937490 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6fq2\" (UniqueName: \"kubernetes.io/projected/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-kube-api-access-n6fq2\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:15.937520 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:15.937523 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a30cca44-b76f-4f8a-ba10-ecdaf6d33222-extensions-socket-volume\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:16.708332 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:16.708308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:16.710594 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:16.710567 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="a30cca44-b76f-4f8a-ba10-ecdaf6d33222" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:16.716347 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:16.716320 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8bmq\" is forbidden: User \"system:node:ip-10-0-138-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-135.ec2.internal' and this object" podUID="a30cca44-b76f-4f8a-ba10-ecdaf6d33222" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8bmq" Jul 06 22:32:17.025907 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:17.025878 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30cca44-b76f-4f8a-ba10-ecdaf6d33222" path="/var/lib/kubelet/pods/a30cca44-b76f-4f8a-ba10-ecdaf6d33222/volumes" Jul 06 22:32:17.715485 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:17.715449 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" event={"ID":"84abebce-f753-43d8-aad8-faf270bde4b7","Type":"ContainerStarted","Data":"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc"} Jul 06 22:32:17.715699 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:17.715580 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:17.737258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:17.737213 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" podStartSLOduration=13.566718331 podStartE2EDuration="17.737200467s" totalImagesPullingTime="4.170482136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:17.734198084 +0000 UTC m=+505.158084781" watchObservedRunningTime="2026-07-06 22:32:17.737200467 +0000 UTC m=+505.161087167" Jul 06 22:32:21.677167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:21.677119 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64db94cbb5-t4rj8" podUID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" containerName="console" containerID="cri-o://594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37" gracePeriod=15 Jul 06 22:32:21.922127 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:21.922107 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:32:22.090328 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090302 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090487 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090355 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090487 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090379 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090488 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090524 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090565 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9w64\" (UniqueName: \"kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090617 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090594 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config\") pod \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\" (UID: \"2bf4f7f5-3f32-4d99-997e-6478126a5ef9\") " Jul 06 22:32:22.090880 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090824 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca" (OuterVolumeSpecName: "service-ca") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:32:22.090954 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090928 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:32:22.090954 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090943 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:32:22.091068 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.090943 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-service-ca\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.091153 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.091132 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config" (OuterVolumeSpecName: "console-config") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:32:22.092691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.092667 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:32:22.092812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.092691 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:32:22.092812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.092699 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64" (OuterVolumeSpecName: "kube-api-access-m9w64") pod "2bf4f7f5-3f32-4d99-997e-6478126a5ef9" (UID: "2bf4f7f5-3f32-4d99-997e-6478126a5ef9"). InnerVolumeSpecName "kube-api-access-m9w64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:22.191553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191529 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-oauth-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.191553 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191552 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-trusted-ca-bundle\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.191697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191561 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-oauth-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.191697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191570 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9w64\" (UniqueName: \"kubernetes.io/projected/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-kube-api-access-m9w64\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.191697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191578 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-config\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.191697 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.191587 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bf4f7f5-3f32-4d99-997e-6478126a5ef9-console-serving-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:22.607446 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.607420 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:22.746095 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.746068 2568 generic.go:356] "Generic (PLEG): container finished" podID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" containerID="594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37" exitCode=0 Jul 06 22:32:22.746534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.746108 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db94cbb5-t4rj8" Jul 06 22:32:22.746534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.746157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db94cbb5-t4rj8" event={"ID":"2bf4f7f5-3f32-4d99-997e-6478126a5ef9","Type":"ContainerDied","Data":"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37"} Jul 06 22:32:22.746534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.746213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db94cbb5-t4rj8" event={"ID":"2bf4f7f5-3f32-4d99-997e-6478126a5ef9","Type":"ContainerDied","Data":"9ad37b2593c360de349388de2eb50a83b1bc8ce96088893c68114dff3c26edd4"} Jul 06 22:32:22.746534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.746243 2568 scope.go:117] "RemoveContainer" containerID="594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37" Jul 06 22:32:22.758197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.758182 2568 scope.go:117] "RemoveContainer" containerID="594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37" Jul 06 22:32:22.758466 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:22.758450 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37\": container with ID starting with 594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37 not found: ID does not exist" containerID="594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37" Jul 06 22:32:22.758534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.758480 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37"} err="failed to get container status \"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37\": rpc error: code = NotFound desc = could not find container \"594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37\": container with ID starting with 594ea1498673e949f53a82887a683bf568a397d4a27e75340c97b1aacbe26c37 not found: ID does not exist" Jul 06 22:32:22.771266 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.771246 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:32:22.775153 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:22.775132 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64db94cbb5-t4rj8"] Jul 06 22:32:23.025870 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:23.025846 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" path="/var/lib/kubelet/pods/2bf4f7f5-3f32-4d99-997e-6478126a5ef9/volumes" Jul 06 22:32:23.689274 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:23.689245 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m257f" Jul 06 22:32:28.724640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:28.724604 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:37.521069 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:37.521037 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:41.392190 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.392158 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:41.392655 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.392352 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" podUID="84abebce-f753-43d8-aad8-faf270bde4b7" containerName="manager" containerID="cri-o://e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc" gracePeriod=10 Jul 06 22:32:41.669860 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.669834 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:41.744700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.744671 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfc4d\" (UniqueName: \"kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d\") pod \"84abebce-f753-43d8-aad8-faf270bde4b7\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " Jul 06 22:32:41.744854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.744752 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume\") pod \"84abebce-f753-43d8-aad8-faf270bde4b7\" (UID: \"84abebce-f753-43d8-aad8-faf270bde4b7\") " Jul 06 22:32:41.745216 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.745194 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "84abebce-f753-43d8-aad8-faf270bde4b7" (UID: "84abebce-f753-43d8-aad8-faf270bde4b7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:41.746574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.746554 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d" (OuterVolumeSpecName: "kube-api-access-vfc4d") pod "84abebce-f753-43d8-aad8-faf270bde4b7" (UID: "84abebce-f753-43d8-aad8-faf270bde4b7"). InnerVolumeSpecName "kube-api-access-vfc4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:41.846133 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.846108 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfc4d\" (UniqueName: \"kubernetes.io/projected/84abebce-f753-43d8-aad8-faf270bde4b7-kube-api-access-vfc4d\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:41.846133 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.846132 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/84abebce-f753-43d8-aad8-faf270bde4b7-extensions-socket-volume\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:32:41.876880 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.876851 2568 generic.go:356] "Generic (PLEG): container finished" podID="84abebce-f753-43d8-aad8-faf270bde4b7" containerID="e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc" exitCode=0 Jul 06 22:32:41.876977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.876887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" event={"ID":"84abebce-f753-43d8-aad8-faf270bde4b7","Type":"ContainerDied","Data":"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc"} Jul 06 22:32:41.876977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.876901 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" Jul 06 22:32:41.876977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.876937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r" event={"ID":"84abebce-f753-43d8-aad8-faf270bde4b7","Type":"ContainerDied","Data":"17042ec437848028570c1d63b40d85c9dc8ce266d2fdca5c7026a66f84e05bcc"} Jul 06 22:32:41.876977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.876965 2568 scope.go:117] "RemoveContainer" containerID="e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc" Jul 06 22:32:41.886607 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.886583 2568 scope.go:117] "RemoveContainer" containerID="e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc" Jul 06 22:32:41.886885 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:32:41.886864 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc\": container with ID starting with e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc not found: ID does not exist" containerID="e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc" Jul 06 22:32:41.886956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.886894 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc"} err="failed to get container status \"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc\": rpc error: code = NotFound desc = could not find container \"e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc\": container with ID starting with e0cae761f5eaef1d9c8dfc47f41d74b0b1cfbff9543fc9824a132583e31e5cbc not found: ID does not exist" Jul 06 22:32:41.901970 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.901921 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:41.905360 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:41.905339 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cfd2r"] Jul 06 22:32:43.025658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:43.025623 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84abebce-f753-43d8-aad8-faf270bde4b7" path="/var/lib/kubelet/pods/84abebce-f753-43d8-aad8-faf270bde4b7/volumes" Jul 06 22:32:45.064610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064530 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t"] Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064893 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" containerName="console" Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064904 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" containerName="console" Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064927 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84abebce-f753-43d8-aad8-faf270bde4b7" containerName="manager" Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064932 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="84abebce-f753-43d8-aad8-faf270bde4b7" containerName="manager" Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.064995 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="84abebce-f753-43d8-aad8-faf270bde4b7" containerName="manager" Jul 06 22:32:45.065046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.065003 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf4f7f5-3f32-4d99-997e-6478126a5ef9" containerName="console" Jul 06 22:32:45.086726 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.086687 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:45.094624 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.094601 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t"] Jul 06 22:32:45.094757 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.094687 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.097129 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.097108 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:32:45.097262 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.097171 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bl4xk\"" Jul 06 22:32:45.173022 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6md\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-kube-api-access-6k6md\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173222 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173222 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.173297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.173289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/544976c9-5625-4109-b0a0-e07b5487fbb1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273792 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273765 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273792 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273825 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/544976c9-5625-4109-b0a0-e07b5487fbb1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.273943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.273918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6md\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-kube-api-access-6k6md\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274200 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274200 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274047 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274305 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274286 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274401 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274381 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274408 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274464 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.274645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.274625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/544976c9-5625-4109-b0a0-e07b5487fbb1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.276162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.276139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.276578 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.276561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.282406 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.282384 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.282579 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.282560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6md\" (UniqueName: \"kubernetes.io/projected/544976c9-5625-4109-b0a0-e07b5487fbb1-kube-api-access-6k6md\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ngc6t\" (UID: \"544976c9-5625-4109-b0a0-e07b5487fbb1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.404534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.404470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:45.491299 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.491255 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:45.539168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.539142 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t"] Jul 06 22:32:45.542380 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:32:45.542348 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544976c9_5625_4109_b0a0_e07b5487fbb1.slice/crio-b36a182b8d8c3dd6507b6764ae104955a4145d936b0ca751ae29652bab3f1b71 WatchSource:0}: Error finding container b36a182b8d8c3dd6507b6764ae104955a4145d936b0ca751ae29652bab3f1b71: Status 404 returned error can't find the container with id b36a182b8d8c3dd6507b6764ae104955a4145d936b0ca751ae29652bab3f1b71 Jul 06 22:32:45.900851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:45.900825 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" event={"ID":"544976c9-5625-4109-b0a0-e07b5487fbb1","Type":"ContainerStarted","Data":"b36a182b8d8c3dd6507b6764ae104955a4145d936b0ca751ae29652bab3f1b71"} Jul 06 22:32:47.910139 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:47.910103 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:47.910412 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:47.910204 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:47.910412 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:47.910235 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:48.920834 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:48.920800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" event={"ID":"544976c9-5625-4109-b0a0-e07b5487fbb1","Type":"ContainerStarted","Data":"d72c0c08e9efd8ec935c6bdefe6e7cb8b6ea0535e1863bac10cfd3bab28a9a6b"} Jul 06 22:32:48.945493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:48.945456 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:48.946183 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:48.946148 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" podStartSLOduration=1.5807095370000002 podStartE2EDuration="3.946134931s" totalImagesPullingTime="2.365425394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:48.944292279 +0000 UTC m=+536.368178979" watchObservedRunningTime="2026-07-06 22:32:48.946134931 +0000 UTC m=+536.370021681" Jul 06 22:32:49.405149 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.405118 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:49.409788 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.409765 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:49.927064 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.927032 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:49.927956 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.927937 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:32:49.943347 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.943323 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:32:49.953015 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.952971 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:49.953380 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.953356 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:49.956162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.956140 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 22:32:49.959918 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:49.959894 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:32:50.015999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.015971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.016295 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.016271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6x9\" (UniqueName: \"kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.045819 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.045789 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:32:50.048478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.048456 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:50.113768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.113743 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:50.116961 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.116942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6x9\" (UniqueName: \"kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.117043 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.116984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.117577 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.117560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.127804 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.127783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6x9\" (UniqueName: \"kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9\") pod \"limitador-limitador-64c94fd64f-s6sgm\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.268579 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.268557 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:50.401628 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.401607 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:32:50.403122 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:32:50.403097 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0adc07f0_d5f3_4a74_ae5f_d0f9ab3a4109.slice/crio-0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4 WatchSource:0}: Error finding container 0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4: Status 404 returned error can't find the container with id 0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4 Jul 06 22:32:50.773174 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.773147 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:50.874342 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.874321 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:50.933394 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:50.933372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" event={"ID":"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109","Type":"ContainerStarted","Data":"0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4"} Jul 06 22:32:53.963193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:53.963159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" event={"ID":"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109","Type":"ContainerStarted","Data":"e4f2db2f973d476d0ae680cf1d8011a819625277cdaa6fdade824bbf58980494"} Jul 06 22:32:53.963658 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:53.963251 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:32:53.980844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:32:53.980797 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" podStartSLOduration=2.384583379 podStartE2EDuration="4.980783965s" totalImagesPullingTime="2.596200586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:53.9787674 +0000 UTC m=+541.402654094" watchObservedRunningTime="2026-07-06 22:32:53.980783965 +0000 UTC m=+541.404670664" Jul 06 22:33:04.969897 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:04.969866 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:33:05.493475 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:05.493442 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:33:05.493659 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:05.493638 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" podUID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" containerName="limitador" containerID="cri-o://e4f2db2f973d476d0ae680cf1d8011a819625277cdaa6fdade824bbf58980494" gracePeriod=30 Jul 06 22:33:06.032806 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.032775 2568 generic.go:356] "Generic (PLEG): container finished" podID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" containerID="e4f2db2f973d476d0ae680cf1d8011a819625277cdaa6fdade824bbf58980494" exitCode=0 Jul 06 22:33:06.033096 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.032846 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" event={"ID":"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109","Type":"ContainerDied","Data":"e4f2db2f973d476d0ae680cf1d8011a819625277cdaa6fdade824bbf58980494"} Jul 06 22:33:06.033096 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.032893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" event={"ID":"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109","Type":"ContainerDied","Data":"0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4"} Jul 06 22:33:06.033096 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.032911 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2e50d40d7730fac605c9823e1285ea1ddeb44c4884979a93a2dc88838de9b4" Jul 06 22:33:06.044082 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.044060 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:33:06.146846 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.146777 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file\") pod \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " Jul 06 22:33:06.146846 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.146815 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl6x9\" (UniqueName: \"kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9\") pod \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\" (UID: \"0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109\") " Jul 06 22:33:06.147124 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.147087 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file" (OuterVolumeSpecName: "config-file") pod "0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" (UID: "0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:33:06.147245 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.147232 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-config-file\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:33:06.148894 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.148873 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9" (OuterVolumeSpecName: "kube-api-access-fl6x9") pod "0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" (UID: "0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109"). InnerVolumeSpecName "kube-api-access-fl6x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:33:06.248143 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:06.248101 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl6x9\" (UniqueName: \"kubernetes.io/projected/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109-kube-api-access-fl6x9\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:33:07.039576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:07.039542 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-s6sgm" Jul 06 22:33:07.057085 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:07.057060 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:33:07.062744 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:07.062720 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-s6sgm"] Jul 06 22:33:09.026452 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:09.026418 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" path="/var/lib/kubelet/pods/0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109/volumes" Jul 06 22:33:11.500687 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.500660 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-88xbw"] Jul 06 22:33:11.501234 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.501214 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" containerName="limitador" Jul 06 22:33:11.501315 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.501237 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" containerName="limitador" Jul 06 22:33:11.501382 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.501359 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0adc07f0-d5f3-4a74-ae5f-d0f9ab3a4109" containerName="limitador" Jul 06 22:33:11.504782 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.504761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.507386 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.507364 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hn29s\"" Jul 06 22:33:11.507496 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.507372 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 22:33:11.517224 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.517200 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-88xbw"] Jul 06 22:33:11.539636 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.539615 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:11.589426 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.589404 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3065add7-670e-49e3-b2a7-15db8035d568-data\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.589525 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.589432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d86j4\" (UniqueName: \"kubernetes.io/projected/3065add7-670e-49e3-b2a7-15db8035d568-kube-api-access-d86j4\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.690093 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.690067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3065add7-670e-49e3-b2a7-15db8035d568-data\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.690201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.690100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d86j4\" (UniqueName: \"kubernetes.io/projected/3065add7-670e-49e3-b2a7-15db8035d568-kube-api-access-d86j4\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.690458 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.690438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3065add7-670e-49e3-b2a7-15db8035d568-data\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.698366 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.698346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d86j4\" (UniqueName: \"kubernetes.io/projected/3065add7-670e-49e3-b2a7-15db8035d568-kube-api-access-d86j4\") pod \"postgres-69fb4594cf-88xbw\" (UID: \"3065add7-670e-49e3-b2a7-15db8035d568\") " pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.818334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.818275 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:11.946284 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:11.946262 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-88xbw"] Jul 06 22:33:11.948967 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:33:11.948934 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3065add7_670e_49e3_b2a7_15db8035d568.slice/crio-bc687d8050554c958a08cfde521c263082355a47349488ff834e3d4e7194fd25 WatchSource:0}: Error finding container bc687d8050554c958a08cfde521c263082355a47349488ff834e3d4e7194fd25: Status 404 returned error can't find the container with id bc687d8050554c958a08cfde521c263082355a47349488ff834e3d4e7194fd25 Jul 06 22:33:12.069925 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:12.069859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-88xbw" event={"ID":"3065add7-670e-49e3-b2a7-15db8035d568","Type":"ContainerStarted","Data":"bc687d8050554c958a08cfde521c263082355a47349488ff834e3d4e7194fd25"} Jul 06 22:33:17.105487 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:17.105395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-88xbw" event={"ID":"3065add7-670e-49e3-b2a7-15db8035d568","Type":"ContainerStarted","Data":"a7c56ab3495120ba5290651c0312e6869f4f2f6379784f26762dc5c5e66f0e9c"} Jul 06 22:33:17.105910 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:17.105556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:17.139768 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:17.139701 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-88xbw" podStartSLOduration=1.327443904 podStartE2EDuration="6.139685976s" totalImagesPullingTime="4.812242072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:17.137345862 +0000 UTC m=+564.561232565" watchObservedRunningTime="2026-07-06 22:33:17.139685976 +0000 UTC m=+564.563572676" Jul 06 22:33:23.143786 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:23.143761 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-88xbw" Jul 06 22:33:23.452610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:23.452521 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:23.766128 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:23.766096 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:29.865200 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.865170 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:29.886301 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.886270 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:29.895851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.895833 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:29.898564 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.898540 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 22:33:29.898687 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.898656 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-722xt\"" Jul 06 22:33:29.898800 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.898783 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 22:33:29.900540 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.900518 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:29.963884 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:29.963859 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:30.056850 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.056828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8srt\" (UniqueName: \"kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.056947 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.056864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.064779 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.064759 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:30.069642 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.069623 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:33:30.073066 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.073049 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.082789 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.082768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:33:30.158258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.158202 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8srt\" (UniqueName: \"kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.158258 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.158238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.158435 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:33:30.158335 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 22:33:30.158435 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:33:30.158385 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert podName:253fa240-23b9-4692-a09b-2c8852202393 nodeName:}" failed. No retries permitted until 2026-07-06 22:33:30.658370417 +0000 UTC m=+578.082257096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert") pod "maas-controller-7d675d577d-cvg7b" (UID: "253fa240-23b9-4692-a09b-2c8852202393") : secret "maas-controller-webhook-cert" not found Jul 06 22:33:30.169049 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.169022 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8srt\" (UniqueName: \"kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.259169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.259144 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.259281 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.259227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68tj\" (UniqueName: \"kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.293760 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.293735 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:30.360041 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.360020 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68tj\" (UniqueName: \"kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.360160 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.360080 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.362448 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.362428 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.368627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.368604 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68tj\" (UniqueName: \"kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj\") pod \"maas-controller-6dccc7f4ff-mq9x4\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.383580 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.383558 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:30.519077 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.519053 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:33:30.520518 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:33:30.520494 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd9ab82_a7e8_4072_8965_34269139e179.slice/crio-329736fb8503306c71382304bb4e91b07380255891b1047c87abdfb4016a1e68 WatchSource:0}: Error finding container 329736fb8503306c71382304bb4e91b07380255891b1047c87abdfb4016a1e68: Status 404 returned error can't find the container with id 329736fb8503306c71382304bb4e91b07380255891b1047c87abdfb4016a1e68 Jul 06 22:33:30.662842 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.662818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.665099 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.665073 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") pod \"maas-controller-7d675d577d-cvg7b\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.807089 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.807061 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:30.940927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:30.940905 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:30.942896 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:33:30.942860 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253fa240_23b9_4692_a09b_2c8852202393.slice/crio-2e33b13e8ffc2bb11a4856c68ddcc57a954bd1fb1e30652afe8e386602473e2d WatchSource:0}: Error finding container 2e33b13e8ffc2bb11a4856c68ddcc57a954bd1fb1e30652afe8e386602473e2d: Status 404 returned error can't find the container with id 2e33b13e8ffc2bb11a4856c68ddcc57a954bd1fb1e30652afe8e386602473e2d Jul 06 22:33:31.191278 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:31.191174 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d675d577d-cvg7b" event={"ID":"253fa240-23b9-4692-a09b-2c8852202393","Type":"ContainerStarted","Data":"2e33b13e8ffc2bb11a4856c68ddcc57a954bd1fb1e30652afe8e386602473e2d"} Jul 06 22:33:31.192928 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:31.192900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" event={"ID":"5cd9ab82-a7e8-4072-8965-34269139e179","Type":"ContainerStarted","Data":"329736fb8503306c71382304bb4e91b07380255891b1047c87abdfb4016a1e68"} Jul 06 22:33:33.014569 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.014491 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:33.100837 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.100809 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:33.206575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.206538 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d675d577d-cvg7b" event={"ID":"253fa240-23b9-4692-a09b-2c8852202393","Type":"ContainerStarted","Data":"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27"} Jul 06 22:33:33.206765 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.206653 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:33.208211 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.208187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" event={"ID":"5cd9ab82-a7e8-4072-8965-34269139e179","Type":"ContainerStarted","Data":"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2"} Jul 06 22:33:33.208319 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.208233 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:33.238397 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.238354 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d675d577d-cvg7b" podStartSLOduration=2.416185105 podStartE2EDuration="4.238340504s" totalImagesPullingTime="1.822155399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:33.235365367 +0000 UTC m=+580.659252068" watchObservedRunningTime="2026-07-06 22:33:33.238340504 +0000 UTC m=+580.662227203" Jul 06 22:33:33.256995 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:33.256946 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" podStartSLOduration=1.02362055 podStartE2EDuration="3.256933114s" totalImagesPullingTime="2.233312564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:33.254263215 +0000 UTC m=+580.678149910" watchObservedRunningTime="2026-07-06 22:33:33.256933114 +0000 UTC m=+580.680819808" Jul 06 22:33:44.219828 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.219794 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:44.220234 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.220050 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:33:44.284799 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.284770 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:44.285006 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.284978 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d675d577d-cvg7b" podUID="253fa240-23b9-4692-a09b-2c8852202393" containerName="manager" containerID="cri-o://257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27" gracePeriod=30 Jul 06 22:33:44.532562 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.532540 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:44.571354 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.571328 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") pod \"253fa240-23b9-4692-a09b-2c8852202393\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " Jul 06 22:33:44.571471 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.571410 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8srt\" (UniqueName: \"kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt\") pod \"253fa240-23b9-4692-a09b-2c8852202393\" (UID: \"253fa240-23b9-4692-a09b-2c8852202393\") " Jul 06 22:33:44.573506 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.573476 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt" (OuterVolumeSpecName: "kube-api-access-n8srt") pod "253fa240-23b9-4692-a09b-2c8852202393" (UID: "253fa240-23b9-4692-a09b-2c8852202393"). InnerVolumeSpecName "kube-api-access-n8srt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:33:44.573596 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.573542 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "253fa240-23b9-4692-a09b-2c8852202393" (UID: "253fa240-23b9-4692-a09b-2c8852202393"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:33:44.673019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.672988 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8srt\" (UniqueName: \"kubernetes.io/projected/253fa240-23b9-4692-a09b-2c8852202393-kube-api-access-n8srt\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:33:44.673019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:44.673017 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/253fa240-23b9-4692-a09b-2c8852202393-webhook-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:33:45.277361 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.277325 2568 generic.go:356] "Generic (PLEG): container finished" podID="253fa240-23b9-4692-a09b-2c8852202393" containerID="257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27" exitCode=0 Jul 06 22:33:45.277839 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.277369 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d675d577d-cvg7b" event={"ID":"253fa240-23b9-4692-a09b-2c8852202393","Type":"ContainerDied","Data":"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27"} Jul 06 22:33:45.277839 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.277391 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d675d577d-cvg7b" Jul 06 22:33:45.277839 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.277424 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d675d577d-cvg7b" event={"ID":"253fa240-23b9-4692-a09b-2c8852202393","Type":"ContainerDied","Data":"2e33b13e8ffc2bb11a4856c68ddcc57a954bd1fb1e30652afe8e386602473e2d"} Jul 06 22:33:45.277839 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.277447 2568 scope.go:117] "RemoveContainer" containerID="257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27" Jul 06 22:33:45.287585 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.287372 2568 scope.go:117] "RemoveContainer" containerID="257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27" Jul 06 22:33:45.287683 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:33:45.287660 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27\": container with ID starting with 257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27 not found: ID does not exist" containerID="257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27" Jul 06 22:33:45.287745 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.287691 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27"} err="failed to get container status \"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27\": rpc error: code = NotFound desc = could not find container \"257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27\": container with ID starting with 257fa315ef6a0416e5378028e53e64573ef3f422544b21f4452a358b44f06f27 not found: ID does not exist" Jul 06 22:33:45.295389 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.295367 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:45.298972 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.298954 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d675d577d-cvg7b"] Jul 06 22:33:45.405473 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:45.405445 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:47.025446 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:47.025413 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253fa240-23b9-4692-a09b-2c8852202393" path="/var/lib/kubelet/pods/253fa240-23b9-4692-a09b-2c8852202393/volumes" Jul 06 22:33:52.990044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:52.990020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:33:52.990558 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:33:52.990022 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:34:02.376468 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.376436 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:02.879444 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.879417 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:02.925562 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.925529 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-f5b95c797-nd5lb"] Jul 06 22:34:02.926071 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.926049 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253fa240-23b9-4692-a09b-2c8852202393" containerName="manager" Jul 06 22:34:02.926197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.926073 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="253fa240-23b9-4692-a09b-2c8852202393" containerName="manager" Jul 06 22:34:02.926197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.926183 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="253fa240-23b9-4692-a09b-2c8852202393" containerName="manager" Jul 06 22:34:02.928347 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.928331 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:02.931144 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.931124 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 22:34:02.932124 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.932101 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-f7f72\"" Jul 06 22:34:02.941249 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.941230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f5b95c797-nd5lb"] Jul 06 22:34:02.984315 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:02.984295 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:03.022375 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.022352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-maas-api-tls\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.022504 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.022434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8x74\" (UniqueName: \"kubernetes.io/projected/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-kube-api-access-w8x74\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.022673 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.022655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-openshift-service-ca\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.123772 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.123744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-maas-api-tls\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.123938 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.123784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8x74\" (UniqueName: \"kubernetes.io/projected/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-kube-api-access-w8x74\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.123938 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.123854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-openshift-service-ca\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.124532 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.124511 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-openshift-service-ca\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.125961 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.125939 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-maas-api-tls\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.137573 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.137513 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8x74\" (UniqueName: \"kubernetes.io/projected/ded6e82f-469e-4ce4-ac6f-338eb53e06ad-kube-api-access-w8x74\") pod \"maas-api-f5b95c797-nd5lb\" (UID: \"ded6e82f-469e-4ce4-ac6f-338eb53e06ad\") " pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.239084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.239055 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:03.298977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.298909 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:03.388223 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.388196 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:03.389113 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.389088 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f5b95c797-nd5lb"] Jul 06 22:34:03.390292 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:34:03.390265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded6e82f_469e_4ce4_ac6f_338eb53e06ad.slice/crio-2fa9dc810ca55ed40815c88922c8cd379a9905abbdc9560acc6c9a4e77452b56 WatchSource:0}: Error finding container 2fa9dc810ca55ed40815c88922c8cd379a9905abbdc9560acc6c9a4e77452b56: Status 404 returned error can't find the container with id 2fa9dc810ca55ed40815c88922c8cd379a9905abbdc9560acc6c9a4e77452b56 Jul 06 22:34:03.439935 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.439906 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w76nr"] Jul 06 22:34:03.443247 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.443228 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.445493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.445476 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 22:34:03.445597 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.445514 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jf5p4\"" Jul 06 22:34:03.451059 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.451036 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w76nr"] Jul 06 22:34:03.529195 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.529154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bf140be-577d-4730-aa6d-c06425bc168e-plugins-config-volume\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.529367 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.529209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnzrp\" (UniqueName: \"kubernetes.io/projected/0bf140be-577d-4730-aa6d-c06425bc168e-kube-api-access-pnzrp\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.630166 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.630125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bf140be-577d-4730-aa6d-c06425bc168e-plugins-config-volume\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.630357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.630189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnzrp\" (UniqueName: \"kubernetes.io/projected/0bf140be-577d-4730-aa6d-c06425bc168e-kube-api-access-pnzrp\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.630874 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.630858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bf140be-577d-4730-aa6d-c06425bc168e-plugins-config-volume\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.638108 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.638060 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnzrp\" (UniqueName: \"kubernetes.io/projected/0bf140be-577d-4730-aa6d-c06425bc168e-kube-api-access-pnzrp\") pod \"payload-processing-58f86c7798-w76nr\" (UID: \"0bf140be-577d-4730-aa6d-c06425bc168e\") " pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.756927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.756898 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:03.897618 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:03.897593 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-w76nr"] Jul 06 22:34:03.898927 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:34:03.898905 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf140be_577d_4730_aa6d_c06425bc168e.slice/crio-396a5922f265c6a644f4f1f94a090ffba0bc0b20a6099dca1819e4c56cd27eba WatchSource:0}: Error finding container 396a5922f265c6a644f4f1f94a090ffba0bc0b20a6099dca1819e4c56cd27eba: Status 404 returned error can't find the container with id 396a5922f265c6a644f4f1f94a090ffba0bc0b20a6099dca1819e4c56cd27eba Jul 06 22:34:04.413794 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:04.413750 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" event={"ID":"0bf140be-577d-4730-aa6d-c06425bc168e","Type":"ContainerStarted","Data":"396a5922f265c6a644f4f1f94a090ffba0bc0b20a6099dca1819e4c56cd27eba"} Jul 06 22:34:04.415610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:04.415579 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f5b95c797-nd5lb" event={"ID":"ded6e82f-469e-4ce4-ac6f-338eb53e06ad","Type":"ContainerStarted","Data":"2fa9dc810ca55ed40815c88922c8cd379a9905abbdc9560acc6c9a4e77452b56"} Jul 06 22:34:06.432984 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.432934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f5b95c797-nd5lb" event={"ID":"ded6e82f-469e-4ce4-ac6f-338eb53e06ad","Type":"ContainerStarted","Data":"ee9dbc6615ea0474eef9b2a52a29209754e0e775f8f479044bffaafc6ac0fcd2"} Jul 06 22:34:06.433453 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.433010 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:06.434879 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.434850 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" event={"ID":"0bf140be-577d-4730-aa6d-c06425bc168e","Type":"ContainerStarted","Data":"ff88cd78cbeae3c479463fb30ee0228258a5d6fd4348d4fe474fa8b82fd3ca32"} Jul 06 22:34:06.435003 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.434972 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:06.452306 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.452261 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-f5b95c797-nd5lb" podStartSLOduration=2.3083097280000002 podStartE2EDuration="4.45224434s" totalImagesPullingTime="2.143934612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:06.449290297 +0000 UTC m=+613.873176999" watchObservedRunningTime="2026-07-06 22:34:06.45224434 +0000 UTC m=+613.876131040" Jul 06 22:34:06.467498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:06.467454 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" podStartSLOduration=1.831369727 podStartE2EDuration="3.467442187s" totalImagesPullingTime="1.63607246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:06.466299978 +0000 UTC m=+613.890186678" watchObservedRunningTime="2026-07-06 22:34:06.467442187 +0000 UTC m=+613.891328886" Jul 06 22:34:11.475109 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.475079 2568 generic.go:356] "Generic (PLEG): container finished" podID="544976c9-5625-4109-b0a0-e07b5487fbb1" containerID="d72c0c08e9efd8ec935c6bdefe6e7cb8b6ea0535e1863bac10cfd3bab28a9a6b" exitCode=0 Jul 06 22:34:11.475498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.475150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" event={"ID":"544976c9-5625-4109-b0a0-e07b5487fbb1","Type":"ContainerDied","Data":"d72c0c08e9efd8ec935c6bdefe6e7cb8b6ea0535e1863bac10cfd3bab28a9a6b"} Jul 06 22:34:11.475542 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.475502 2568 scope.go:117] "RemoveContainer" containerID="d72c0c08e9efd8ec935c6bdefe6e7cb8b6ea0535e1863bac10cfd3bab28a9a6b" Jul 06 22:34:11.476487 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.476460 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:11.476545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.476531 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:11.476580 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:11.476562 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:12.450146 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:12.450113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-f5b95c797-nd5lb" Jul 06 22:34:12.493145 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:12.484856 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" event={"ID":"544976c9-5625-4109-b0a0-e07b5487fbb1","Type":"ContainerStarted","Data":"d09384de8b46f67966b4f1f1106e77e5104c41d713ed7acb38876feb1af7c518"} Jul 06 22:34:13.405168 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:13.405133 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:34:13.405372 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:13.405259 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ngc6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 22:34:13.405372 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:13.405302 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" podUID="544976c9-5625-4109-b0a0-e07b5487fbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 22:34:13.490138 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:13.490093 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:13.571597 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:13.571568 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.405297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:14.404874 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ngc6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 22:34:14.405297 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:14.404931 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" podUID="544976c9-5625-4109-b0a0-e07b5487fbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 22:34:15.406265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:15.405598 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ngc6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 22:34:15.406265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:15.405657 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" podUID="544976c9-5625-4109-b0a0-e07b5487fbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 22:34:16.405683 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:16.405643 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ngc6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 22:34:16.406228 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:16.406195 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" podUID="544976c9-5625-4109-b0a0-e07b5487fbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 22:34:17.408928 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:17.408898 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:34:17.409439 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:17.409281 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:34:17.409945 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:17.409923 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ngc6t" Jul 06 22:34:17.443483 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:17.443463 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-w76nr" Jul 06 22:34:28.332601 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:28.332569 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:28.451526 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:28.451498 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:36.377551 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.377508 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr"] Jul 06 22:34:36.381609 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.381585 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.385896 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.385872 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 22:34:36.386081 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.385998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 22:34:36.386187 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.386062 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 22:34:36.386187 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.386063 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p5kpm\"" Jul 06 22:34:36.401031 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.401007 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr"] Jul 06 22:34:36.456319 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.456295 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:36.525242 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525217 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46tn9\" (UniqueName: \"kubernetes.io/projected/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-kube-api-access-46tn9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.525343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.525388 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525363 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.525425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.525425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.525491 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.525425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626635 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626777 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626642 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626777 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626777 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46tn9\" (UniqueName: \"kubernetes.io/projected/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-kube-api-access-46tn9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626958 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.626958 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.626862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.627066 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.627041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.627179 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.627159 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.627392 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.627363 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.629157 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.629093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.629260 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.629231 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.643990 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.643968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46tn9\" (UniqueName: \"kubernetes.io/projected/c5e9f6fd-14b2-4e3e-9354-c25d578e45f3-kube-api-access-46tn9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr\" (UID: \"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.693815 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.693787 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:36.845021 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.844987 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr"] Jul 06 22:34:36.846191 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:34:36.846167 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e9f6fd_14b2_4e3e_9354_c25d578e45f3.slice/crio-089e251e577bcce318918c04f72e38d9c8ddf29ff77defcce87cdda9e92f92dc WatchSource:0}: Error finding container 089e251e577bcce318918c04f72e38d9c8ddf29ff77defcce87cdda9e92f92dc: Status 404 returned error can't find the container with id 089e251e577bcce318918c04f72e38d9c8ddf29ff77defcce87cdda9e92f92dc Jul 06 22:34:36.847474 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:36.847459 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:34:37.654792 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:37.654753 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" event={"ID":"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3","Type":"ContainerStarted","Data":"089e251e577bcce318918c04f72e38d9c8ddf29ff77defcce87cdda9e92f92dc"} Jul 06 22:34:38.662132 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:38.662094 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" event={"ID":"c5e9f6fd-14b2-4e3e-9354-c25d578e45f3","Type":"ContainerStarted","Data":"06c75e60803d666317071160888cb62aa6fc721a3ac99a5a7fffddbee0fb05ec"} Jul 06 22:34:38.682977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:38.682932 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" podStartSLOduration=1.6736169589999998 podStartE2EDuration="2.68291664s" totalImagesPullingTime="1.009299681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:38.68197213 +0000 UTC m=+646.105858832" watchObservedRunningTime="2026-07-06 22:34:38.68291664 +0000 UTC m=+646.106803339" Jul 06 22:34:46.694344 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:46.694303 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:46.694769 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:46.694378 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:46.707278 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:46.707249 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:46.719983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:46.719958 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr" Jul 06 22:34:58.403273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:34:58.403210 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:17.128046 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:17.128009 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:23.698240 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.698204 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd"] Jul 06 22:35:23.702527 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.702510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.705135 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.705118 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 22:35:23.710283 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.710248 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd"] Jul 06 22:35:23.727368 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.727348 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:23.822327 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822304 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.822419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.822419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822398 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqf9c\" (UniqueName: \"kubernetes.io/projected/e843b04f-970e-48ef-bea3-2736deb244e0-kube-api-access-dqf9c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.822498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e843b04f-970e-48ef-bea3-2736deb244e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.822537 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.822537 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.822521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.922958 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.922932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e843b04f-970e-48ef-bea3-2736deb244e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923067 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.922964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923067 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.922984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923067 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923230 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923230 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqf9c\" (UniqueName: \"kubernetes.io/projected/e843b04f-970e-48ef-bea3-2736deb244e0-kube-api-access-dqf9c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923400 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923377 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923526 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923471 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.923597 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.923540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.932640 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.932606 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e843b04f-970e-48ef-bea3-2736deb244e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.933140 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.933115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e843b04f-970e-48ef-bea3-2736deb244e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:23.934987 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:23.934962 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqf9c\" (UniqueName: \"kubernetes.io/projected/e843b04f-970e-48ef-bea3-2736deb244e0-kube-api-access-dqf9c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd\" (UID: \"e843b04f-970e-48ef-bea3-2736deb244e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:24.017185 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:24.017154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:24.151682 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:24.151652 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd"] Jul 06 22:35:24.153321 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:35:24.153298 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode843b04f_970e_48ef_bea3_2736deb244e0.slice/crio-943a4b96aed6fc80ed796aa9b904a39a0de644bee3316630d3279c12bc0fcea1 WatchSource:0}: Error finding container 943a4b96aed6fc80ed796aa9b904a39a0de644bee3316630d3279c12bc0fcea1: Status 404 returned error can't find the container with id 943a4b96aed6fc80ed796aa9b904a39a0de644bee3316630d3279c12bc0fcea1 Jul 06 22:35:24.944514 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:24.944487 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" event={"ID":"e843b04f-970e-48ef-bea3-2736deb244e0","Type":"ContainerStarted","Data":"72d7e12cf1dd9c746ac3305397e76f823e1cda7c7a9d4bc327dcefbdf2ce742b"} Jul 06 22:35:24.944919 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:24.944533 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" event={"ID":"e843b04f-970e-48ef-bea3-2736deb244e0","Type":"ContainerStarted","Data":"943a4b96aed6fc80ed796aa9b904a39a0de644bee3316630d3279c12bc0fcea1"} Jul 06 22:35:24.963190 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:24.963144 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" podStartSLOduration=1.781992265 podStartE2EDuration="1.963128894s" totalImagesPullingTime="181.136629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:35:24.962076611 +0000 UTC m=+692.385963312" watchObservedRunningTime="2026-07-06 22:35:24.963128894 +0000 UTC m=+692.387015594" Jul 06 22:35:34.017319 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:34.017287 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:34.017691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:34.017341 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:34.030178 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:34.030151 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:35.025212 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:35.025189 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd" Jul 06 22:35:36.183355 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:36.183323 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:52.008097 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:35:52.008009 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:13.392893 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:36:13.392857 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:57.025460 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:36:57.025422 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:57.124839 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:36:57.124813 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:58.178131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:36:58.178094 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:58.268883 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:36:58.268854 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:05.795675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:37:05.795611 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:05.895920 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:37:05.895888 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:08.171080 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.171050 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:08.271161 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.271136 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:38:08.271343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.271322 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" podUID="5cd9ab82-a7e8-4072-8965-34269139e179" containerName="manager" containerID="cri-o://5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2" gracePeriod=30 Jul 06 22:38:08.528628 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.528605 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:38:08.629538 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.629510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert\") pod \"5cd9ab82-a7e8-4072-8965-34269139e179\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " Jul 06 22:38:08.629675 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.629580 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68tj\" (UniqueName: \"kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj\") pod \"5cd9ab82-a7e8-4072-8965-34269139e179\" (UID: \"5cd9ab82-a7e8-4072-8965-34269139e179\") " Jul 06 22:38:08.631494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.631465 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5cd9ab82-a7e8-4072-8965-34269139e179" (UID: "5cd9ab82-a7e8-4072-8965-34269139e179"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:38:08.631625 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.631604 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj" (OuterVolumeSpecName: "kube-api-access-x68tj") pod "5cd9ab82-a7e8-4072-8965-34269139e179" (UID: "5cd9ab82-a7e8-4072-8965-34269139e179"). InnerVolumeSpecName "kube-api-access-x68tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:38:08.731253 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.731184 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cd9ab82-a7e8-4072-8965-34269139e179-webhook-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:38:08.731253 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.731206 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68tj\" (UniqueName: \"kubernetes.io/projected/5cd9ab82-a7e8-4072-8965-34269139e179-kube-api-access-x68tj\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:38:08.921896 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.921867 2568 generic.go:356] "Generic (PLEG): container finished" podID="5cd9ab82-a7e8-4072-8965-34269139e179" containerID="5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2" exitCode=0 Jul 06 22:38:08.922023 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.921909 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" Jul 06 22:38:08.922023 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.921944 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" event={"ID":"5cd9ab82-a7e8-4072-8965-34269139e179","Type":"ContainerDied","Data":"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2"} Jul 06 22:38:08.922023 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.921984 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dccc7f4ff-mq9x4" event={"ID":"5cd9ab82-a7e8-4072-8965-34269139e179","Type":"ContainerDied","Data":"329736fb8503306c71382304bb4e91b07380255891b1047c87abdfb4016a1e68"} Jul 06 22:38:08.922023 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.922005 2568 scope.go:117] "RemoveContainer" containerID="5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2" Jul 06 22:38:08.934875 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.934856 2568 scope.go:117] "RemoveContainer" containerID="5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2" Jul 06 22:38:08.935130 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:38:08.935109 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2\": container with ID starting with 5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2 not found: ID does not exist" containerID="5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2" Jul 06 22:38:08.935230 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.935136 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2"} err="failed to get container status \"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2\": rpc error: code = NotFound desc = could not find container \"5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2\": container with ID starting with 5431155a18b44cadab7e3aa7c4b5782ee525fd68e355e031eae15c3830a36ae2 not found: ID does not exist" Jul 06 22:38:08.943926 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.943905 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:38:08.948105 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:08.948074 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dccc7f4ff-mq9x4"] Jul 06 22:38:09.032972 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:09.032948 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd9ab82-a7e8-4072-8965-34269139e179" path="/var/lib/kubelet/pods/5cd9ab82-a7e8-4072-8965-34269139e179/volumes" Jul 06 22:38:09.608151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:09.608121 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:46.587668 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:46.587574 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:46.641720 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:46.641694 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:53.036915 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:53.036890 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:38:53.038545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:53.038524 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:38:53.076671 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:53.076643 2568 scope.go:117] "RemoveContainer" containerID="e4f2db2f973d476d0ae680cf1d8011a819625277cdaa6fdade824bbf58980494" Jul 06 22:38:54.127535 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:54.127503 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:55.615427 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:38:55.615388 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:01.078503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:01.078468 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:01.189194 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:01.189167 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:01.280226 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:01.280194 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:01.404472 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:01.404414 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:07.478826 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:07.478794 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:07.575536 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:39:07.575505 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:05.953549 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:40:05.953516 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:11.650273 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:40:11.650232 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:11.700825 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:40:11.700793 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:59.277633 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:40:59.277596 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:41:34.426016 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:41:34.425980 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:43:02.625430 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:43:02.625393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:43:48.884619 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:43:48.884587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:43:53.073859 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:43:53.073833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:43:53.079603 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:43:53.079584 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:44:00.233759 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:44:00.233729 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:12.335057 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:46:12.335027 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:48:53.115097 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:48:53.115062 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:48:53.124574 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:48:53.124544 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:48:56.475478 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:48:56.475435 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:46.544744 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:49:46.544680 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:53.941332 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:49:53.941294 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:54.839405 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:49:54.839369 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:49:54.898926 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:49:54.898890 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:02.241532 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:02.241494 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:07.284842 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:07.284779 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:10.026275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:10.026238 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:10.125725 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:10.125679 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:10.464003 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:10.463909 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:16.572187 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:16.572152 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:16.642520 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:16.642490 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:16.786566 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:16.786526 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:16.883795 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:16.883672 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:17.955912 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:17.955875 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.034167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:18.034128 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.103806 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:18.103767 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.170935 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:18.170869 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.653345 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:18.653297 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:18.752703 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:18.752663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:20.656911 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:20.656826 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:22.973932 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:22.973897 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:23.193836 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:23.193796 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:23.321428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:23.321393 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:23.467214 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:23.467181 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:25.167811 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:25.167775 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:29.150131 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:29.150097 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:29.250421 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:29.250363 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:29.371765 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:29.371726 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:29.429805 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:29.429679 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:30.560082 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:30.560047 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:30.658615 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:30.658564 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:30.760019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:30.759946 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:30.988923 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:30.988806 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:31.173180 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:31.173147 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:31.274025 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:31.273980 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:32.518229 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:32.518194 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:35.681127 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:35.681088 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:36.046645 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:36.046609 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:41.706655 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:41.706611 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:41.813545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:41.813498 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:43.268419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:43.268388 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.772019 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:47.771922 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.834474 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:47.834436 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:47.985142 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:47.985109 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:48.042618 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:48.042488 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.180486 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.180454 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.264244 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.264197 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.334080 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.334045 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.433268 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.433156 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.822155 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.822120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:49.922181 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:49.922149 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:51.104192 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:51.104158 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:53.548779 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:53.548695 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:53.734686 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:53.734633 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:53.832039 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:53.831948 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:53.900305 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:53.900275 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:55.425878 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:55.425828 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:59.716243 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:59.716188 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:50:59.816537 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:50:59.816500 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:00.181630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:00.181597 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:00.277943 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:00.277907 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:00.379784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:00.379753 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:01.735851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:01.735817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:07.978026 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:07.977987 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:08.088872 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:08.088830 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:08.178581 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:08.178544 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:08.290656 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:08.290619 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:08.661278 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:08.661185 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:34.613235 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:34.613186 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:40.629380 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:40.629343 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:40.735674 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:40.735602 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:40.831058 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:40.831022 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.758048 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:51:56.758003 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:03.207334 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:03.207297 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:03.307977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:03.307938 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:03.409318 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:03.409266 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:13.902156 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:13.902106 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:14.690166 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:14.690125 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.551285 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:20.551243 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.617059 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:20.617024 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.704476 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:20.704419 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.802206 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:20.802100 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.909767 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:20.909728 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.631386 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:21.631350 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.728133 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:21.728099 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.827368 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:21.827338 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:23.394669 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:23.394613 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:29.452075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:29.452019 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:29.517593 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:29.517543 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:30.103042 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:30.103008 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.141854 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:36.141818 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.206520 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:36.206483 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.372436 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:36.372403 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.762292 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:36.762249 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:36.984510 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:36.984474 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:39.342154 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:39.342115 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:39.441237 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:39.441179 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:39.540296 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:39.540260 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:39.640959 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:39.640842 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:40.019119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:40.019072 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:40.117194 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:40.117154 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:43.824494 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:43.824458 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:44.483902 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:44.483871 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:44.641693 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:44.641654 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:44.905104 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:44.905064 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:50.786227 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:50.786192 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:50.846906 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:50.846872 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:51.186534 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:51.186427 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:51.590530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:51.590477 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:51.690056 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:51.690018 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.474241 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:57.474178 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.537300 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:57.537251 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.729360 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:57.729254 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:57.951132 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:57.951097 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.078193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:58.078154 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.178068 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:58.178032 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:58.282441 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:52:58.282404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:01.968434 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:01.968386 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:02.068971 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:02.068920 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.409656 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:04.409593 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.511914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:04.511883 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.610330 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:04.610297 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:04.770691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:04.770656 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:10.818134 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:10.818090 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:10.878488 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:10.878448 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:13.235846 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:13.235787 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:17.560833 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:17.560799 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:17.886516 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:17.886404 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:18.232844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:18.232752 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:20.540700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:20.540650 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:20.621040 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:20.621008 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:20.695419 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:20.695385 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:20.816589 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:20.816457 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:21.106229 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:21.106088 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:21.213344 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:21.213302 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:25.035329 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:25.035275 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:34.068521 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:34.068459 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:34.165972 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:34.165921 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:34.302969 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:34.302921 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:41.858291 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:41.858252 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:41.958860 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:41.958818 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:53.167222 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:53.167190 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:53:53.179058 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:53:53.179029 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:54:07.697084 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:07.697039 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:08.208228 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:08.208189 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:13.879938 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:13.879893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:18.964461 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:18.964415 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:55.992001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:55.991962 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:57.280775 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:54:57.280731 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:02.634537 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:02.634502 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:02.706798 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:02.706755 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:02.930727 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:02.930619 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:03.153545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:03.153508 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:04.225783 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:04.225746 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:04.317631 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:04.317596 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:04.420376 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:04.420340 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:05.141612 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:05.141571 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:05.238637 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:05.238598 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:05.337851 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:05.337817 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:06.739438 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:06.739399 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:12.664247 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:12.664198 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:12.729174 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:12.729142 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:13.340914 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:13.340882 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:19.782039 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:19.781942 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:19.844499 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:19.844467 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:19.914927 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:19.914893 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:20.015627 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:20.015590 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:30.499076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:30.499037 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:30.842932 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:30.842839 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:51.775999 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:51.775958 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:57.855322 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:57.855279 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:57.955702 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:57.955667 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:58.204220 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:58.204109 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:58.533250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:58.533199 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:59.052275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:55:59.052238 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.245041 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.245003 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.320820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.320786 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.398150 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.398116 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.636306 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.636272 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.826691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.826654 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:01.926761 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:01.926648 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:05.735445 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:05.735411 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:06.057977 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.057940 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:06.351499 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.351370 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:56:06.352075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.352049 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd9ab82-a7e8-4072-8965-34269139e179" containerName="manager" Jul 06 22:56:06.352075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.352075 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd9ab82-a7e8-4072-8965-34269139e179" containerName="manager" Jul 06 22:56:06.352300 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.352224 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd9ab82-a7e8-4072-8965-34269139e179" containerName="manager" Jul 06 22:56:06.355630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.355610 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.358294 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.358271 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-878700-openshift-default-dockercfg-pqp9z\"" Jul 06 22:56:06.369490 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.369459 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:56:06.390578 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.390547 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:06.445772 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.445976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.445976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.445976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.445976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445907 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.445976 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmkb\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.446240 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.445998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.446240 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.446095 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.446240 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.446157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547578 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.547843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547873 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.547908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmkb\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.548156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548325 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.548227 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548379 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.548344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548379 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.548369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.548466 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.548428 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.550157 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.550135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.550375 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.550354 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.558381 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.558350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmkb\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.558615 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.558595 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token\") pod \"e2e-inf-b-878700-openshift-default-6999544c67-l4gks\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.668505 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.668397 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:06.829051 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.829024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:56:06.830802 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:56:06.830771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d1d0cb_22d2_48d9_b765_2033112bdfd1.slice/crio-22e2d2f665fbe5dab653da1d9268cf625084b3c234d2c0c5f27a490c682f18aa WatchSource:0}: Error finding container 22e2d2f665fbe5dab653da1d9268cf625084b3c234d2c0c5f27a490c682f18aa: Status 404 returned error can't find the container with id 22e2d2f665fbe5dab653da1d9268cf625084b3c234d2c0c5f27a490c682f18aa Jul 06 22:56:06.833207 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.833157 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:06.833306 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.833270 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:06.833353 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:06.833320 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:07.173365 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.173318 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:07.419201 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.419166 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerStarted","Data":"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778"} Jul 06 22:56:07.419398 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.419219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerStarted","Data":"22e2d2f665fbe5dab653da1d9268cf625084b3c234d2c0c5f27a490c682f18aa"} Jul 06 22:56:07.441499 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.441361 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podStartSLOduration=1.441340279 podStartE2EDuration="1.441340279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:56:07.44010319 +0000 UTC m=+1934.863989893" watchObservedRunningTime="2026-07-06 22:56:07.441340279 +0000 UTC m=+1934.865226993" Jul 06 22:56:07.669632 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.669594 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:07.675244 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:07.675213 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:08.426245 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:08.426205 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:08.427329 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:08.427306 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:09.332169 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:09.332133 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:09.408447 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:09.408412 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:09.488433 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:09.488385 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:09.663706 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:09.663613 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:09.901801 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:09.901765 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:10.002599 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:10.002569 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:13.819430 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:13.819391 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:20.602364 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:20.602326 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:22.685603 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:22.685563 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:22.786871 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:22.786836 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:23.428250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.428152 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:23.428250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.428221 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:23.533500 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.533464 2568 generic.go:356] "Generic (PLEG): container finished" podID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerID="e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778" exitCode=0 Jul 06 22:56:23.533746 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.533544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerDied","Data":"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778"} Jul 06 22:56:23.534092 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.534074 2568 scope.go:117] "RemoveContainer" containerID="e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778" Jul 06 22:56:23.535295 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.535263 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:23.535384 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.535367 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:23.535424 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:23.535408 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:56:24.542567 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:24.542528 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerStarted","Data":"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3"} Jul 06 22:56:24.668998 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:24.668958 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:24.669341 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:24.669310 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:24.669484 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:24.669363 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:25.669408 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:25.669368 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:25.669857 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:25.669430 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:26.669493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:26.669445 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:26.669964 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:26.669541 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:27.669009 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:27.668963 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:27.669217 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:27.669040 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:28.669575 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:28.669535 2568 patch_prober.go:28] interesting pod/e2e-inf-b-878700-openshift-default-6999544c67-l4gks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 06 22:56:28.670058 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:28.669609 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 06 22:56:29.675296 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:29.675262 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:29.675841 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:29.675652 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:29.676530 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:29.676507 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:56:31.252164 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:31.252120 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:31.354115 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:31.354076 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:31.639409 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:31.639298 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:31.737026 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:31.736983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:57.716259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:56:57.716144 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:00.624087 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:00.624055 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:32.803198 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:32.803154 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:33.799170 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:33.799113 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:33.950557 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:33.950521 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.345167 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:34.345127 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.444949 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:34.444915 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.545840 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:34.545810 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.623912 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:34.623792 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:39.419875 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:39.419842 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:45.230075 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:57:45.230033 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:16.416261 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:16.416139 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:16.696691 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:16.696587 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:16.935546 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:16.935510 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:17.099284 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:17.099247 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:17.528251 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:17.528193 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:17.638776 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:17.638685 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:17.739151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:17.739109 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:17.883458 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:17.883373 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:23.474849 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.474815 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:23.536705 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.536666 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:23.713844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.713795 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:58:23.714069 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.714042 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" containerID="cri-o://9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3" gracePeriod=30 Jul 06 22:58:23.733250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.733143 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:23.959014 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:23.958973 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:24.354493 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:24.354464 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:24.622357 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:24.622258 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:25.067670 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:25.067637 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:27.975834 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:27.975784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.044545 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.044484 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.115259 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.115206 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.517953 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.517873 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.618343 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.618302 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.719098 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.719047 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:28.981642 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:28.981615 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:58:29.044700 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044661 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044771 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044821 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jmkb\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044855 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044881 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044901 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.044934 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044920 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.045265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.044941 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.045265 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045061 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket\") pod \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\" (UID: \"24d1d0cb-22d2-48d9-b765-2033112bdfd1\") " Jul 06 22:58:29.045376 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045351 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:58:29.045432 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045385 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:58:29.045570 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045546 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istiod-ca-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.045674 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045573 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-certs\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.045674 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045581 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:58:29.045827 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045795 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:58:29.045873 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.045814 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data" (OuterVolumeSpecName: "istio-data") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:58:29.047088 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.047065 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:58:29.047450 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.047424 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb" (OuterVolumeSpecName: "kube-api-access-2jmkb") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "kube-api-access-2jmkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:58:29.047522 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.047503 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token" (OuterVolumeSpecName: "istio-token") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:58:29.047576 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.047533 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24d1d0cb-22d2-48d9-b765-2033112bdfd1" (UID: "24d1d0cb-22d2-48d9-b765-2033112bdfd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146509 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-credential-socket\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146542 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-token\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146557 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-podinfo\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146568 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jmkb\" (UniqueName: \"kubernetes.io/projected/24d1d0cb-22d2-48d9-b765-2033112bdfd1-kube-api-access-2jmkb\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146579 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-data\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146591 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-istio-envoy\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.146610 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.146604 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24d1d0cb-22d2-48d9-b765-2033112bdfd1-workload-socket\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:58:29.328686 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.328651 2568 generic.go:356] "Generic (PLEG): container finished" podID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerID="9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3" exitCode=0 Jul 06 22:58:29.328991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.328746 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerDied","Data":"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3"} Jul 06 22:58:29.328991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.328765 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" Jul 06 22:58:29.328991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.328815 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks" event={"ID":"24d1d0cb-22d2-48d9-b765-2033112bdfd1","Type":"ContainerDied","Data":"22e2d2f665fbe5dab653da1d9268cf625084b3c234d2c0c5f27a490c682f18aa"} Jul 06 22:58:29.328991 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.328841 2568 scope.go:117] "RemoveContainer" containerID="9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3" Jul 06 22:58:29.340402 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.340382 2568 scope.go:117] "RemoveContainer" containerID="e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778" Jul 06 22:58:29.350454 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.350428 2568 scope.go:117] "RemoveContainer" containerID="9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3" Jul 06 22:58:29.351016 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:58:29.350986 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3\": container with ID starting with 9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3 not found: ID does not exist" containerID="9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3" Jul 06 22:58:29.351152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.351028 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3"} err="failed to get container status \"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3\": rpc error: code = NotFound desc = could not find container \"9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3\": container with ID starting with 9ec156cbe44fca4b19cfd6e32e5884503fa9f8247378403387d862a35557f7e3 not found: ID does not exist" Jul 06 22:58:29.351152 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.351054 2568 scope.go:117] "RemoveContainer" containerID="e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778" Jul 06 22:58:29.351401 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:58:29.351362 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778\": container with ID starting with e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778 not found: ID does not exist" containerID="e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778" Jul 06 22:58:29.351555 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.351396 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778"} err="failed to get container status \"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778\": rpc error: code = NotFound desc = could not find container \"e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778\": container with ID starting with e2d8943e12193102cfb4533f0e97e88bf8bd9d6811d021f04bfb8112ecbd7778 not found: ID does not exist" Jul 06 22:58:29.354159 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.354130 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:58:29.357496 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:29.357471 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-878700-openshift-default-6999544c67-l4gks"] Jul 06 22:58:31.026376 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:31.026340 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" path="/var/lib/kubelet/pods/24d1d0cb-22d2-48d9-b765-2033112bdfd1/volumes" Jul 06 22:58:32.386351 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:32.386312 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:32.840337 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:32.840301 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:33.113036 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.112945 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:58:33.113620 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.113599 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 22:58:33.113670 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.113625 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 22:58:33.113784 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.113772 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 22:58:33.120360 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.120325 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.127423 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.127390 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-da1e1a-openshift-default-dockercfg-8pmx4\"" Jul 06 22:58:33.130752 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.130698 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:58:33.142027 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.141972 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:33.190559 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190516 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190771 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190771 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190771 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190771 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190862 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qtbt\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.190940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.190928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292248 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292370 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292479 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292442 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qtbt\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292812 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292917 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292810 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.292917 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.292863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.293102 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.293081 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.293162 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.293113 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.293197 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.293148 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.294630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.294610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.295047 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.295026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.300540 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.300512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.300766 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.300743 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qtbt\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt\") pod \"e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.436592 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.436489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:33.521987 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.521943 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:33.593498 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.593461 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:58:33.595327 ip-10-0-138-135 kubenswrapper[2568]: W0706 22:58:33.595298 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62524d2e_8a6d_4ff6_a0c6_c132a81404c0.slice/crio-c570d4491d987d955ba2e6cb6867ef3b6549d0bef49c28f22c650e1c804d88f4 WatchSource:0}: Error finding container c570d4491d987d955ba2e6cb6867ef3b6549d0bef49c28f22c650e1c804d88f4: Status 404 returned error can't find the container with id c570d4491d987d955ba2e6cb6867ef3b6549d0bef49c28f22c650e1c804d88f4 Jul 06 22:58:33.597605 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.597568 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:33.597751 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.597657 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:33.597751 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:33.597704 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:34.365184 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.365141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerStarted","Data":"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9"} Jul 06 22:58:34.365369 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.365202 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerStarted","Data":"c570d4491d987d955ba2e6cb6867ef3b6549d0bef49c28f22c650e1c804d88f4"} Jul 06 22:58:34.387250 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.387192 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podStartSLOduration=1.387175557 podStartE2EDuration="1.387175557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:58:34.383968019 +0000 UTC m=+2081.807854719" watchObservedRunningTime="2026-07-06 22:58:34.387175557 +0000 UTC m=+2081.811062258" Jul 06 22:58:34.437405 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.437355 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:34.442961 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.442928 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:34.758994 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.758964 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:34.858940 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:34.858904 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:35.258820 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:35.258786 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:35.319125 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:35.319090 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:35.373141 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:35.373111 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:35.374323 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:35.374301 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:36.265080 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:36.265039 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:36.363705 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:36.363676 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:36.521844 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:36.521749 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:36.731305 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:36.731272 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:37.033198 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:37.033156 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:37.133318 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:37.133285 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:38.733316 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:38.733272 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:38.834816 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:38.834777 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:40.778033 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:40.777999 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:48.818153 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:48.818113 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:49.206863 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:49.206830 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:49.309503 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:49.309461 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:49.408353 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:49.408311 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:49.518286 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:49.518250 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:51.414973 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:51.414919 2568 patch_prober.go:28] interesting pod/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 22:58:51.415421 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:51.414988 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 22:58:52.482275 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.482238 2568 generic.go:356] "Generic (PLEG): container finished" podID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerID="859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9" exitCode=0 Jul 06 22:58:52.482770 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.482312 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerDied","Data":"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9"} Jul 06 22:58:52.482878 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.482861 2568 scope.go:117] "RemoveContainer" containerID="859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9" Jul 06 22:58:52.483983 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.483948 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:52.484118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.484042 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:52.484118 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:52.484092 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:58:53.238817 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:53.238791 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:58:53.243847 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:53.243815 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 22:58:53.494385 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:53.494274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerStarted","Data":"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e"} Jul 06 22:58:54.437202 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:54.437155 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:54.437482 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:54.437456 2568 patch_prober.go:28] interesting pod/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 06 22:58:54.437604 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:54.437518 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 06 22:58:55.414843 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.414811 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:55.437246 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.437207 2568 patch_prober.go:28] interesting pod/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 06 22:58:55.437444 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.437269 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 06 22:58:55.517005 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.516966 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:55.680978 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.680882 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:55.897979 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:55.897941 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:56.057004 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.056960 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:56.437081 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.436971 2568 patch_prober.go:28] interesting pod/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 06 22:58:56.437081 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.437048 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 06 22:58:56.467895 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.467859 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:56.610290 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.610224 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:56.703390 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.703285 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:56.855764 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:56.855730 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:57.514601 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:57.514565 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:57.515106 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:57.515005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:58:57.516048 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:58:57.516023 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:59:02.826975 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:02.826933 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:02.887194 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:02.887153 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:03.067696 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.067654 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:59:03.068003 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.067969 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" containerID="cri-o://fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e" gracePeriod=30 Jul 06 22:59:03.100086 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.099989 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:03.346428 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.346394 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:03.654044 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.653997 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:03.997878 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:03.997826 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:04.516924 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:04.516871 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.044728 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.044685 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.142214 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.142144 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.334630 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.334510 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.474808 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.474766 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.755175 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.755134 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:07.856088 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:07.856055 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:08.372878 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.372850 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:59:08.467905 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.467870 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.467922 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.467969 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468000 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468033 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468119 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468066 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468389 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468118 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468389 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468163 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qtbt\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468389 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468192 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs\") pod \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\" (UID: \"62524d2e-8a6d-4ff6-a0c6-c132a81404c0\") " Jul 06 22:59:08.468389 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468370 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:59:08.468583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468480 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:59:08.468643 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468575 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:59:08.468643 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468586 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:59:08.468810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468692 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-credential-socket\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.468810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468746 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-certs\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.468810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468760 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istiod-ca-cert\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.468810 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.468772 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-workload-socket\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.469076 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.469053 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:59:08.470300 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.470271 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:59:08.470583 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.470561 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt" (OuterVolumeSpecName: "kube-api-access-8qtbt") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "kube-api-access-8qtbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:59:08.470698 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.470669 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:59:08.470992 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.470972 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62524d2e-8a6d-4ff6-a0c6-c132a81404c0" (UID: "62524d2e-8a6d-4ff6-a0c6-c132a81404c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:59:08.569539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.569489 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-token\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.569539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.569527 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-podinfo\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.569539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.569535 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-data\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.569539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.569543 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-istio-envoy\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.569539 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.569553 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qtbt\" (UniqueName: \"kubernetes.io/projected/62524d2e-8a6d-4ff6-a0c6-c132a81404c0-kube-api-access-8qtbt\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 22:59:08.602757 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.602604 2568 generic.go:356] "Generic (PLEG): container finished" podID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerID="fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e" exitCode=0 Jul 06 22:59:08.602757 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.602664 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" Jul 06 22:59:08.603001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.602700 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerDied","Data":"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e"} Jul 06 22:59:08.603001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.602820 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8" event={"ID":"62524d2e-8a6d-4ff6-a0c6-c132a81404c0","Type":"ContainerDied","Data":"c570d4491d987d955ba2e6cb6867ef3b6549d0bef49c28f22c650e1c804d88f4"} Jul 06 22:59:08.603001 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.602853 2568 scope.go:117] "RemoveContainer" containerID="fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e" Jul 06 22:59:08.613561 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.613540 2568 scope.go:117] "RemoveContainer" containerID="859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9" Jul 06 22:59:08.623671 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.623642 2568 scope.go:117] "RemoveContainer" containerID="fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e" Jul 06 22:59:08.624064 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:59:08.624041 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e\": container with ID starting with fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e not found: ID does not exist" containerID="fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e" Jul 06 22:59:08.624193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.624074 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e"} err="failed to get container status \"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e\": rpc error: code = NotFound desc = could not find container \"fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e\": container with ID starting with fa84e8852350eaed8c490b50ab1a82400d302238115c2bb50bf49c9669a3748e not found: ID does not exist" Jul 06 22:59:08.624193 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.624095 2568 scope.go:117] "RemoveContainer" containerID="859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9" Jul 06 22:59:08.624458 ip-10-0-138-135 kubenswrapper[2568]: E0706 22:59:08.624438 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9\": container with ID starting with 859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9 not found: ID does not exist" containerID="859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9" Jul 06 22:59:08.624516 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.624466 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9"} err="failed to get container status \"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9\": rpc error: code = NotFound desc = could not find container \"859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9\": container with ID starting with 859d27ae2096ed699a83e510cd1215785dbe11d1ac8a1ee784e72d5cf2463cb9 not found: ID does not exist" Jul 06 22:59:08.626425 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.626366 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:59:08.629824 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:08.629800 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-da1e1a-openshift-default-69b576d78c-cfsr8"] Jul 06 22:59:09.026796 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:09.026760 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" path="/var/lib/kubelet/pods/62524d2e-8a6d-4ff6-a0c6-c132a81404c0/volumes" Jul 06 22:59:11.537437 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:11.537403 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:11.904438 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:11.904329 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:12.168241 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:12.168132 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:12.273666 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:12.273636 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.077372 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.077333 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.177938 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.177900 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.305270 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.305236 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.541397 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.541356 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.825014 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.824906 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:15.928069 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:15.928005 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:19.590151 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:19.590105 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:28.573832 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:28.573779 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:28.674775 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:28.674693 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:36.527374 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:36.527331 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:36.626845 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:36.626807 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:44.204604 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:44.204553 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:58.387056 ip-10-0-138-135 kubenswrapper[2568]: I0706 22:59:58.387015 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:00.136825 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.136789 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk"] Jul 06 23:00:00.137284 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137271 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.137284 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137285 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.137370 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137305 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 23:00:00.137370 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137311 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 23:00:00.137437 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137394 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.137437 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.137407 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="24d1d0cb-22d2-48d9-b765-2033112bdfd1" containerName="istio-proxy" Jul 06 23:00:00.140488 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.140463 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:00.148318 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.148287 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l"] Jul 06 23:00:00.149151 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.149124 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.149151 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.149148 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.149367 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.149320 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62524d2e-8a6d-4ff6-a0c6-c132a81404c0" containerName="istio-proxy" Jul 06 23:00:00.153246 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.153217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:00.154127 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.154105 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-sl7bm"] Jul 06 23:00:00.167755 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.167342 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk"] Jul 06 23:00:00.167755 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.167402 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l"] Jul 06 23:00:00.167755 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.167529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:00.178341 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.178309 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-sl7bm"] Jul 06 23:00:00.320206 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.320150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh42d\" (UniqueName: \"kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d\") pod \"maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l\" (UID: \"8fe064d8-e5b5-4c37-a17c-47be08525b44\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:00.320206 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.320215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrck\" (UniqueName: \"kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck\") pod \"maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk\" (UID: \"77112e6a-9905-444b-b4af-123f50b11533\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:00.320520 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.320295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dwp\" (UniqueName: \"kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp\") pod \"maas-api-key-cleanup-29722980-sl7bm\" (UID: \"962afa06-6467-4e88-9dda-2387aa1a8fba\") " pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:00.421956 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.421840 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh42d\" (UniqueName: \"kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d\") pod \"maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l\" (UID: \"8fe064d8-e5b5-4c37-a17c-47be08525b44\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:00.421956 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.421899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrck\" (UniqueName: \"kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck\") pod \"maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk\" (UID: \"77112e6a-9905-444b-b4af-123f50b11533\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:00.421956 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.421928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dwp\" (UniqueName: \"kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp\") pod \"maas-api-key-cleanup-29722980-sl7bm\" (UID: \"962afa06-6467-4e88-9dda-2387aa1a8fba\") " pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:00.431226 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.431180 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrck\" (UniqueName: \"kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck\") pod \"maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk\" (UID: \"77112e6a-9905-444b-b4af-123f50b11533\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:00.431226 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.431206 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dwp\" (UniqueName: \"kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp\") pod \"maas-api-key-cleanup-29722980-sl7bm\" (UID: \"962afa06-6467-4e88-9dda-2387aa1a8fba\") " pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:00.431481 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.431328 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh42d\" (UniqueName: \"kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d\") pod \"maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l\" (UID: \"8fe064d8-e5b5-4c37-a17c-47be08525b44\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:00.453332 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.453297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:00.482652 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.482615 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:00.490143 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.490109 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:00.694828 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.694792 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722980-sl7bm"] Jul 06 23:00:00.700658 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.700639 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:00:00.836255 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.836223 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk"] Jul 06 23:00:00.838360 ip-10-0-138-135 kubenswrapper[2568]: W0706 23:00:00.838327 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77112e6a_9905_444b_b4af_123f50b11533.slice/crio-4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6 WatchSource:0}: Error finding container 4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6: Status 404 returned error can't find the container with id 4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6 Jul 06 23:00:00.876640 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.876609 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l"] Jul 06 23:00:00.878333 ip-10-0-138-135 kubenswrapper[2568]: W0706 23:00:00.878293 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe064d8_e5b5_4c37_a17c_47be08525b44.slice/crio-0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f WatchSource:0}: Error finding container 0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f: Status 404 returned error can't find the container with id 0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f Jul 06 23:00:00.947785 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.947641 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" event={"ID":"8fe064d8-e5b5-4c37-a17c-47be08525b44","Type":"ContainerStarted","Data":"0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f"} Jul 06 23:00:00.949026 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.948999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" event={"ID":"962afa06-6467-4e88-9dda-2387aa1a8fba","Type":"ContainerStarted","Data":"7746082ba72441fae20ed902028115808c8c5d6efa3921c1b41b5f88899e5bcb"} Jul 06 23:00:00.950261 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:00.950235 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" event={"ID":"77112e6a-9905-444b-b4af-123f50b11533","Type":"ContainerStarted","Data":"4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6"} Jul 06 23:00:04.067618 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:04.067576 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:05.988429 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:05.988318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" event={"ID":"8fe064d8-e5b5-4c37-a17c-47be08525b44","Type":"ContainerStarted","Data":"05b039628d2134964c35658b05a3a9a8631ab7f48f0dfb545f1f4fd9635c227a"} Jul 06 23:00:05.989998 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:05.989964 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" event={"ID":"962afa06-6467-4e88-9dda-2387aa1a8fba","Type":"ContainerStarted","Data":"d4ee5ca342d3bc5920c5ae8954f67f2ea33ad31af43d4f8cec30c4ee7f3af44f"} Jul 06 23:00:05.999436 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:05.999389 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" event={"ID":"77112e6a-9905-444b-b4af-123f50b11533","Type":"ContainerStarted","Data":"133e42f6c1444f1e28c4268cf5ea2befef556b29ed227fc88e345240a3337619"} Jul 06 23:00:06.004378 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:06.004321 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" podStartSLOduration=1.424355084 podStartE2EDuration="6.004300152s" totalImagesPullingTime="4.579945068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:06.003418179 +0000 UTC m=+2173.427304874" watchObservedRunningTime="2026-07-06 23:00:06.004300152 +0000 UTC m=+2173.428186852" Jul 06 23:00:06.020692 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:06.020606 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" podStartSLOduration=1.394784979 podStartE2EDuration="6.020586547s" totalImagesPullingTime="4.625801568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:06.017678706 +0000 UTC m=+2173.441565421" watchObservedRunningTime="2026-07-06 23:00:06.020586547 +0000 UTC m=+2173.444473283" Jul 06 23:00:06.033116 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:06.033058 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" podStartSLOduration=1.323685639 podStartE2EDuration="6.033038602s" totalImagesPullingTime="4.709352963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:06.032138326 +0000 UTC m=+2173.456025027" watchObservedRunningTime="2026-07-06 23:00:06.033038602 +0000 UTC m=+2173.456925331" Jul 06 23:00:07.011074 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.011038 2568 generic.go:356] "Generic (PLEG): container finished" podID="8fe064d8-e5b5-4c37-a17c-47be08525b44" containerID="05b039628d2134964c35658b05a3a9a8631ab7f48f0dfb545f1f4fd9635c227a" exitCode=0 Jul 06 23:00:07.011557 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.011086 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" event={"ID":"8fe064d8-e5b5-4c37-a17c-47be08525b44","Type":"ContainerDied","Data":"05b039628d2134964c35658b05a3a9a8631ab7f48f0dfb545f1f4fd9635c227a"} Jul 06 23:00:07.012834 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.012807 2568 generic.go:356] "Generic (PLEG): container finished" podID="962afa06-6467-4e88-9dda-2387aa1a8fba" containerID="d4ee5ca342d3bc5920c5ae8954f67f2ea33ad31af43d4f8cec30c4ee7f3af44f" exitCode=0 Jul 06 23:00:07.012982 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.012885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" event={"ID":"962afa06-6467-4e88-9dda-2387aa1a8fba","Type":"ContainerDied","Data":"d4ee5ca342d3bc5920c5ae8954f67f2ea33ad31af43d4f8cec30c4ee7f3af44f"} Jul 06 23:00:07.014384 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.014360 2568 generic.go:356] "Generic (PLEG): container finished" podID="77112e6a-9905-444b-b4af-123f50b11533" containerID="133e42f6c1444f1e28c4268cf5ea2befef556b29ed227fc88e345240a3337619" exitCode=0 Jul 06 23:00:07.014511 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:07.014393 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" event={"ID":"77112e6a-9905-444b-b4af-123f50b11533","Type":"ContainerDied","Data":"133e42f6c1444f1e28c4268cf5ea2befef556b29ed227fc88e345240a3337619"} Jul 06 23:00:08.190441 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.190394 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:08.235170 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.235139 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:08.239420 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.239393 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:08.292620 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.292510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2dwp\" (UniqueName: \"kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp\") pod \"962afa06-6467-4e88-9dda-2387aa1a8fba\" (UID: \"962afa06-6467-4e88-9dda-2387aa1a8fba\") " Jul 06 23:00:08.292620 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.292568 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvrck\" (UniqueName: \"kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck\") pod \"77112e6a-9905-444b-b4af-123f50b11533\" (UID: \"77112e6a-9905-444b-b4af-123f50b11533\") " Jul 06 23:00:08.292897 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.292687 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh42d\" (UniqueName: \"kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d\") pod \"8fe064d8-e5b5-4c37-a17c-47be08525b44\" (UID: \"8fe064d8-e5b5-4c37-a17c-47be08525b44\") " Jul 06 23:00:08.295040 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.295011 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d" (OuterVolumeSpecName: "kube-api-access-rh42d") pod "8fe064d8-e5b5-4c37-a17c-47be08525b44" (UID: "8fe064d8-e5b5-4c37-a17c-47be08525b44"). InnerVolumeSpecName "kube-api-access-rh42d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:08.295040 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.295021 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck" (OuterVolumeSpecName: "kube-api-access-hvrck") pod "77112e6a-9905-444b-b4af-123f50b11533" (UID: "77112e6a-9905-444b-b4af-123f50b11533"). InnerVolumeSpecName "kube-api-access-hvrck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:08.295223 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.295048 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp" (OuterVolumeSpecName: "kube-api-access-r2dwp") pod "962afa06-6467-4e88-9dda-2387aa1a8fba" (UID: "962afa06-6467-4e88-9dda-2387aa1a8fba"). InnerVolumeSpecName "kube-api-access-r2dwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:08.394435 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.394393 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh42d\" (UniqueName: \"kubernetes.io/projected/8fe064d8-e5b5-4c37-a17c-47be08525b44-kube-api-access-rh42d\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 23:00:08.394435 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.394427 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2dwp\" (UniqueName: \"kubernetes.io/projected/962afa06-6467-4e88-9dda-2387aa1a8fba-kube-api-access-r2dwp\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 23:00:08.394435 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:08.394439 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvrck\" (UniqueName: \"kubernetes.io/projected/77112e6a-9905-444b-b4af-123f50b11533-kube-api-access-hvrck\") on node \"ip-10-0-138-135.ec2.internal\" DevicePath \"\"" Jul 06 23:00:09.028428 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.028395 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" Jul 06 23:00:09.028654 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.028393 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l" event={"ID":"8fe064d8-e5b5-4c37-a17c-47be08525b44","Type":"ContainerDied","Data":"0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f"} Jul 06 23:00:09.028654 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.028557 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e9d3b06d82149a0fc4bd5e840c891f65579ad8c45073034b10ff8de8b29f94f" Jul 06 23:00:09.030073 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.030049 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" Jul 06 23:00:09.030073 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.030055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722980-sl7bm" event={"ID":"962afa06-6467-4e88-9dda-2387aa1a8fba","Type":"ContainerDied","Data":"7746082ba72441fae20ed902028115808c8c5d6efa3921c1b41b5f88899e5bcb"} Jul 06 23:00:09.030289 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.030101 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7746082ba72441fae20ed902028115808c8c5d6efa3921c1b41b5f88899e5bcb" Jul 06 23:00:09.031729 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.031684 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" Jul 06 23:00:09.031868 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.031741 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk" event={"ID":"77112e6a-9905-444b-b4af-123f50b11533","Type":"ContainerDied","Data":"4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6"} Jul 06 23:00:09.031868 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:00:09.031787 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8ba6a1802dd1c19bd5e8e8d319aa372129cc566613c79b950766bf081b9ea6" Jul 06 23:02:00.124485 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:02:00.124445 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:01.083042 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:02:01.083004 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:13.915408 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:02:13.915370 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:29.896327 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:02:29.896289 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:11.592614 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:11.592575 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:12.573235 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:12.573187 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:18.008086 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:18.008012 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:35.547146 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:35.547105 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:35.647165 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:35.647130 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:38.008326 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:38.008284 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:43.227004 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:43.226968 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:53.289995 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:53.289967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 23:03:53.295228 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:03:53.295208 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 23:04:19.411758 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:19.411663 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:20.315816 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:20.315784 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:21.349103 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:21.349056 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:21.742902 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:21.742806 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:21.864405 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:21.864367 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:21.964339 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:21.964295 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:22.106395 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:22.106364 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:22.111706 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:22.111676 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l"] Jul 06 23:04:22.114485 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:22.114463 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-c8326f-29722980-5fm4l"] Jul 06 23:04:23.026508 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:23.026477 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe064d8-e5b5-4c37-a17c-47be08525b44" path="/var/lib/kubelet/pods/8fe064d8-e5b5-4c37-a17c-47be08525b44/volumes" Jul 06 23:04:26.820681 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:26.820645 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:37.378836 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:37.378799 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:37.478889 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:04:37.478857 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:04.025111 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:04.025069 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:05.013112 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:05.013083 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk"] Jul 06 23:05:05.017349 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:05.017322 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-b0de62-29722980-vvlkk"] Jul 06 23:05:05.026803 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:05.026777 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77112e6a-9905-444b-b4af-123f50b11533" path="/var/lib/kubelet/pods/77112e6a-9905-444b-b4af-123f50b11533/volumes" Jul 06 23:05:06.759802 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:06.759769 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:11.509157 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:11.509121 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:11.611113 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:11.611081 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:11.805409 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:11.805305 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:12.157365 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:12.157281 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:17.371596 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:17.371564 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f5b95c797-nd5lb_ded6e82f-469e-4ce4-ac6f-338eb53e06ad/maas-api/0.log" Jul 06 23:05:17.597098 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:17.597071 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-sl7bm_962afa06-6467-4e88-9dda-2387aa1a8fba/cleanup/0.log" Jul 06 23:05:18.177204 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:18.177177 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85fcf54485-pmr2f_bd756dfe-1513-40c8-815c-d0a52e286d40/copy-manifests/0.log" Jul 06 23:05:18.184786 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:18.184755 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85fcf54485-pmr2f_bd756dfe-1513-40c8-815c-d0a52e286d40/manager/0.log" Jul 06 23:05:18.415622 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:18.415585 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-88xbw_3065add7-670e-49e3-b2a7-15db8035d568/postgres/0.log" Jul 06 23:05:19.191311 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.191281 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/util/0.log" Jul 06 23:05:19.198657 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.198630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/pull/0.log" Jul 06 23:05:19.205432 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.205411 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/extract/0.log" Jul 06 23:05:19.312467 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.312442 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/util/0.log" Jul 06 23:05:19.319089 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.319056 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/pull/0.log" Jul 06 23:05:19.325451 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.325420 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/extract/0.log" Jul 06 23:05:19.431977 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.431953 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/util/0.log" Jul 06 23:05:19.438741 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.438694 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/pull/0.log" Jul 06 23:05:19.445603 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.445538 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/extract/0.log" Jul 06 23:05:19.554618 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.554596 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/util/0.log" Jul 06 23:05:19.561439 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.561418 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/pull/0.log" Jul 06 23:05:19.567755 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.567734 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/extract/0.log" Jul 06 23:05:19.925883 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:19.925854 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tv5kr_a07c6877-e086-4358-9dc1-2ccda2350cfa/manager/0.log" Jul 06 23:05:20.033806 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:20.033778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xmb6s_99254afe-0db6-42f8-b546-a44d4916cc6d/kuadrant-console-plugin/0.log" Jul 06 23:05:20.159061 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:20.159027 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7j4f_b940cf71-c3b5-487a-a742-bcb2a293a197/registry-server/0.log" Jul 06 23:05:20.520115 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:20.520081 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m257f_4b036617-a4b4-4fcb-acf4-6ddcba99716b/manager/0.log" Jul 06 23:05:21.321019 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:21.320987 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/1.log" Jul 06 23:05:21.566261 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:21.566218 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w76nr_0bf140be-577d-4730-aa6d-c06425bc168e/payload-processing/0.log" Jul 06 23:05:21.684251 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:21.684166 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b777fbb4c-rnppq_b0472d95-0970-4d8d-8adb-de2f7f9eb1e2/router/0.log" Jul 06 23:05:22.025403 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:22.025375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xl4jr_c5e9f6fd-14b2-4e3e-9354-c25d578e45f3/main/0.log" Jul 06 23:05:22.371267 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:22.371184 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7z8kd_e843b04f-970e-48ef-bea3-2736deb244e0/main/0.log" Jul 06 23:05:26.752191 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752157 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lsnx/must-gather-dc459"] Jul 06 23:05:26.752629 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752596 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe064d8-e5b5-4c37-a17c-47be08525b44" containerName="cleanup" Jul 06 23:05:26.752629 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752610 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe064d8-e5b5-4c37-a17c-47be08525b44" containerName="cleanup" Jul 06 23:05:26.752629 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752626 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="962afa06-6467-4e88-9dda-2387aa1a8fba" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752633 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="962afa06-6467-4e88-9dda-2387aa1a8fba" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752660 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77112e6a-9905-444b-b4af-123f50b11533" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752665 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="77112e6a-9905-444b-b4af-123f50b11533" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752758 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="77112e6a-9905-444b-b4af-123f50b11533" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752767 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="962afa06-6467-4e88-9dda-2387aa1a8fba" containerName="cleanup" Jul 06 23:05:26.752850 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.752779 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe064d8-e5b5-4c37-a17c-47be08525b44" containerName="cleanup" Jul 06 23:05:26.757143 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.757124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.759646 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.759624 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lsnx\"/\"kube-root-ca.crt\"" Jul 06 23:05:26.760694 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.760674 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8lsnx\"/\"default-dockercfg-h582k\"" Jul 06 23:05:26.760935 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.760674 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8lsnx\"/\"openshift-service-ca.crt\"" Jul 06 23:05:26.763013 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.762983 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:26.764526 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.764504 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lsnx/must-gather-dc459"] Jul 06 23:05:26.852974 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.852939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9106f53-b379-46ea-a435-59e4a2189bb2-must-gather-output\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.853149 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.853018 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6csbc\" (UniqueName: \"kubernetes.io/projected/b9106f53-b379-46ea-a435-59e4a2189bb2-kube-api-access-6csbc\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.860203 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.860176 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:26.953869 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.953832 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9106f53-b379-46ea-a435-59e4a2189bb2-must-gather-output\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.954056 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.953937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6csbc\" (UniqueName: \"kubernetes.io/projected/b9106f53-b379-46ea-a435-59e4a2189bb2-kube-api-access-6csbc\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.954193 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.954175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9106f53-b379-46ea-a435-59e4a2189bb2-must-gather-output\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:26.961843 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:26.961820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6csbc\" (UniqueName: \"kubernetes.io/projected/b9106f53-b379-46ea-a435-59e4a2189bb2-kube-api-access-6csbc\") pod \"must-gather-dc459\" (UID: \"b9106f53-b379-46ea-a435-59e4a2189bb2\") " pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:27.068099 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:27.068008 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lsnx/must-gather-dc459" Jul 06 23:05:27.207551 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:27.207522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lsnx/must-gather-dc459"] Jul 06 23:05:27.208771 ip-10-0-138-135 kubenswrapper[2568]: W0706 23:05:27.208748 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9106f53_b379_46ea_a435_59e4a2189bb2.slice/crio-9242abec63eaad1ebe89de9076d67ef6e67b5bf2dd174654628c6240eb05a9d2 WatchSource:0}: Error finding container 9242abec63eaad1ebe89de9076d67ef6e67b5bf2dd174654628c6240eb05a9d2: Status 404 returned error can't find the container with id 9242abec63eaad1ebe89de9076d67ef6e67b5bf2dd174654628c6240eb05a9d2 Jul 06 23:05:27.210594 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:27.210575 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 23:05:28.027019 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:28.026992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lsnx/must-gather-dc459" event={"ID":"b9106f53-b379-46ea-a435-59e4a2189bb2","Type":"ContainerStarted","Data":"9242abec63eaad1ebe89de9076d67ef6e67b5bf2dd174654628c6240eb05a9d2"} Jul 06 23:05:29.037666 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.037633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lsnx/must-gather-dc459" event={"ID":"b9106f53-b379-46ea-a435-59e4a2189bb2","Type":"ContainerStarted","Data":"6b4ad4a15ce650fcdbec629afed39ed3476e11be69c6aeab539debe5797e90b4"} Jul 06 23:05:29.038070 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.037676 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lsnx/must-gather-dc459" event={"ID":"b9106f53-b379-46ea-a435-59e4a2189bb2","Type":"ContainerStarted","Data":"115088af486f95b92a82d41c2710ed84b48b5f805fa056673e323d78444c6146"} Jul 06 23:05:29.054913 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.054865 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lsnx/must-gather-dc459" podStartSLOduration=2.263504486 podStartE2EDuration="3.054848479s" totalImagesPullingTime="791.343993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:05:29.051761774 +0000 UTC m=+2496.475648476" watchObservedRunningTime="2026-07-06 23:05:29.054848479 +0000 UTC m=+2496.478735221" Jul 06 23:05:29.619236 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.619200 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-26bcb_0668c2b5-b49e-4f1c-96e2-48abe887370b/global-pull-secret-syncer/0.log" Jul 06 23:05:29.756994 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.756957 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" Jul 06 23:05:29.861335 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:29.861298 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-135.ec2.internal_b6793de04b12ec0ed6561fe050df193a/haproxy/0.log" Jul 06 23:05:34.441937 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.441815 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/extract/0.log" Jul 06 23:05:34.468175 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.468143 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/util/0.log" Jul 06 23:05:34.492700 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.492667 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598qgvs_3b8adab5-0234-47ce-9713-0282f713eb53/pull/0.log" Jul 06 23:05:34.518756 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.518723 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/extract/0.log" Jul 06 23:05:34.540194 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.540142 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/util/0.log" Jul 06 23:05:34.564420 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.564391 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08bwh9_aa121bc4-6801-4a41-a7ea-f88768a3f28b/pull/0.log" Jul 06 23:05:34.594561 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.594530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/extract/0.log" Jul 06 23:05:34.616135 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.616108 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/util/0.log" Jul 06 23:05:34.638830 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.638806 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jg7b9_8a493ef3-e541-4de8-8c4d-fba9bf82e8f8/pull/0.log" Jul 06 23:05:34.672776 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.672749 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/extract/0.log" Jul 06 23:05:34.700264 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.700187 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/util/0.log" Jul 06 23:05:34.721685 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:34.721647 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nltmd_4cf87dab-5132-4e9f-a3e1-d155f5bca166/pull/0.log" Jul 06 23:05:35.069257 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:35.069197 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tv5kr_a07c6877-e086-4358-9dc1-2ccda2350cfa/manager/0.log" Jul 06 23:05:35.103368 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:35.103278 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xmb6s_99254afe-0db6-42f8-b546-a44d4916cc6d/kuadrant-console-plugin/0.log" Jul 06 23:05:35.152698 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:35.152356 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7j4f_b940cf71-c3b5-487a-a742-bcb2a293a197/registry-server/0.log" Jul 06 23:05:35.387500 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:35.387396 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-m257f_4b036617-a4b4-4fcb-acf4-6ddcba99716b/manager/0.log" Jul 06 23:05:37.060495 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.060417 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/alertmanager/0.log" Jul 06 23:05:37.084463 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.084436 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/config-reloader/0.log" Jul 06 23:05:37.109471 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.109444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/kube-rbac-proxy-web/0.log" Jul 06 23:05:37.132948 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.132923 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/kube-rbac-proxy/0.log" Jul 06 23:05:37.157612 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.157571 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/kube-rbac-proxy-metric/0.log" Jul 06 23:05:37.179083 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.179051 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/prom-label-proxy/0.log" Jul 06 23:05:37.200198 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.200167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5daca71-3a59-47e5-982e-88069c44e2d8/init-config-reloader/0.log" Jul 06 23:05:37.249830 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.249796 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-j57jt_75145716-3545-4e92-95bf-51d2a676d1a9/cluster-monitoring-operator/0.log" Jul 06 23:05:37.363657 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.363567 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-764cd5fbfc-j9jf9_f5635750-f0b7-46d2-8e40-fc0843cd3f31/metrics-server/0.log" Jul 06 23:05:37.423615 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.423583 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m458_4faadc2b-a5c2-4fff-8997-bd95b68669ad/node-exporter/0.log" Jul 06 23:05:37.447284 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.447259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m458_4faadc2b-a5c2-4fff-8997-bd95b68669ad/kube-rbac-proxy/0.log" Jul 06 23:05:37.471312 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.471287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9m458_4faadc2b-a5c2-4fff-8997-bd95b68669ad/init-textfile/0.log" Jul 06 23:05:37.651239 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.651161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5hk8l_2698b3d9-5e14-44a0-b22e-76dcac8858eb/kube-rbac-proxy-main/0.log" Jul 06 23:05:37.675788 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.675764 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5hk8l_2698b3d9-5e14-44a0-b22e-76dcac8858eb/kube-rbac-proxy-self/0.log" Jul 06 23:05:37.696350 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.696316 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5hk8l_2698b3d9-5e14-44a0-b22e-76dcac8858eb/openshift-state-metrics/0.log" Jul 06 23:05:37.983931 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:37.983853 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79ddcc4bd5-v65jn_1bb1cd00-75e1-4768-ac29-f81881df394d/telemeter-client/0.log" Jul 06 23:05:38.010043 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.009986 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79ddcc4bd5-v65jn_1bb1cd00-75e1-4768-ac29-f81881df394d/reload/0.log" Jul 06 23:05:38.032727 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.032685 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79ddcc4bd5-v65jn_1bb1cd00-75e1-4768-ac29-f81881df394d/kube-rbac-proxy/0.log" Jul 06 23:05:38.062181 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.062153 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/thanos-query/0.log" Jul 06 23:05:38.082699 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.082673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/kube-rbac-proxy-web/0.log" Jul 06 23:05:38.102918 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.102892 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/kube-rbac-proxy/0.log" Jul 06 23:05:38.125056 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.125023 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/prom-label-proxy/0.log" Jul 06 23:05:38.150369 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.150330 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/kube-rbac-proxy-rules/0.log" Jul 06 23:05:38.175847 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:38.175817 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79877d8cf6-4cpc7_47cdccf3-50ba-4d36-b313-df9fc7173ed8/kube-rbac-proxy-metrics/0.log" Jul 06 23:05:39.315598 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.315572 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6sz52_f4e232c5-e087-46de-9396-f4808a2003ff/networking-console-plugin/0.log" Jul 06 23:05:39.946858 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.946816 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z"] Jul 06 23:05:39.949092 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.949064 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/1.log" Jul 06 23:05:39.951513 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.950873 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:39.957355 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.957323 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-59gps_9fcf9833-ef22-4dd9-866c-6a65cae2c31d/console-operator/2.log" Jul 06 23:05:39.959853 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:39.959820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z"] Jul 06 23:05:40.131069 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.131028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-podres\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.131276 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.131130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l5sc\" (UniqueName: \"kubernetes.io/projected/cda74a97-2285-4ff3-ade0-ffe31ce14565-kube-api-access-8l5sc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.131276 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.131182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-sys\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.131276 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.131208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-lib-modules\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.131450 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.131282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-proc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232114 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-sys\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232114 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-lib-modules\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-proc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-sys\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232210 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-podres\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l5sc\" (UniqueName: \"kubernetes.io/projected/cda74a97-2285-4ff3-ade0-ffe31ce14565-kube-api-access-8l5sc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232292 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-podres\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232208 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-proc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.232344 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.232307 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda74a97-2285-4ff3-ade0-ffe31ce14565-lib-modules\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.240738 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.240680 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l5sc\" (UniqueName: \"kubernetes.io/projected/cda74a97-2285-4ff3-ade0-ffe31ce14565-kube-api-access-8l5sc\") pod \"perf-node-gather-daemonset-w526z\" (UID: \"cda74a97-2285-4ff3-ade0-ffe31ce14565\") " pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.267549 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.267502 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:40.478993 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.478966 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z"] Jul 06 23:05:40.560743 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:40.560695 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b78d55597-phf49_15afc2cd-211c-4109-ab04-55dc987c6108/console/0.log" Jul 06 23:05:41.151151 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:41.151117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" event={"ID":"cda74a97-2285-4ff3-ade0-ffe31ce14565","Type":"ContainerStarted","Data":"6dfdc62861be4b70979693b867984b97a7903805651e18a411da561d2db5a46b"} Jul 06 23:05:41.151341 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:41.151182 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" event={"ID":"cda74a97-2285-4ff3-ade0-ffe31ce14565","Type":"ContainerStarted","Data":"4275d7278b5e43862fbaf412b565e15d413b8a625c166f228e028a3f08c3c1f7"} Jul 06 23:05:41.151341 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:41.151213 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:41.168060 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:41.167998 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" podStartSLOduration=2.167977655 podStartE2EDuration="2.167977655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:05:41.166946459 +0000 UTC m=+2508.590833161" watchObservedRunningTime="2026-07-06 23:05:41.167977655 +0000 UTC m=+2508.591864356" Jul 06 23:05:41.168268 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:41.168236 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-c9xdc_7361691f-2c2d-4ed4-9c69-7399f919f0a0/volume-data-source-validator/0.log" Jul 06 23:05:42.174846 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:42.174820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hfhp_b6c275a3-b107-40ce-b6f0-abe35a13fb91/dns/0.log" Jul 06 23:05:42.194872 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:42.194843 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hfhp_b6c275a3-b107-40ce-b6f0-abe35a13fb91/kube-rbac-proxy/0.log" Jul 06 23:05:42.311680 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:42.311649 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5djdn_809634c9-67e6-45fd-abb6-4908b9f11684/dns-node-resolver/0.log" Jul 06 23:05:42.958595 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:42.958561 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pnl72_b42a6238-f202-4ebe-8abe-379c0c2c9bfc/node-ca/0.log" Jul 06 23:05:44.098374 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:44.098332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/0.log" Jul 06 23:05:44.162139 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:44.162044 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/1.log" Jul 06 23:05:44.232208 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:44.232164 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w76nr_0bf140be-577d-4730-aa6d-c06425bc168e/payload-processing/0.log" Jul 06 23:05:44.257435 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:44.257399 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b777fbb4c-rnppq_b0472d95-0970-4d8d-8adb-de2f7f9eb1e2/router/0.log" Jul 06 23:05:44.955914 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:44.955833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84zzz_29117865-f4b4-4cb9-be0a-684d7d7b2cb1/serve-healthcheck-canary/0.log" Jul 06 23:05:45.440579 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:45.440539 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mktxb_dfa9be99-701e-497c-bbfc-0f33ffa9370d/insights-operator/0.log" Jul 06 23:05:45.445590 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:45.445567 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mktxb_dfa9be99-701e-497c-bbfc-0f33ffa9370d/insights-operator/1.log" Jul 06 23:05:45.609365 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:45.609337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvgzk_78da5cd8-2770-46b9-b0a9-428df8899c61/kube-rbac-proxy/0.log" Jul 06 23:05:45.629735 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:45.629682 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvgzk_78da5cd8-2770-46b9-b0a9-428df8899c61/exporter/0.log" Jul 06 23:05:45.650472 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:45.650445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvgzk_78da5cd8-2770-46b9-b0a9-428df8899c61/extractor/0.log" Jul 06 23:05:47.167784 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:47.167689 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8lsnx/perf-node-gather-daemonset-w526z" Jul 06 23:05:47.908552 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:47.908520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f5b95c797-nd5lb_ded6e82f-469e-4ce4-ac6f-338eb53e06ad/maas-api/0.log" Jul 06 23:05:47.948223 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:47.948195 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722980-sl7bm_962afa06-6467-4e88-9dda-2387aa1a8fba/cleanup/0.log" Jul 06 23:05:48.244512 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:48.244431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85fcf54485-pmr2f_bd756dfe-1513-40c8-815c-d0a52e286d40/manager/0.log" Jul 06 23:05:48.263605 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:48.263576 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85fcf54485-pmr2f_bd756dfe-1513-40c8-815c-d0a52e286d40/copy-manifests/0.log" Jul 06 23:05:48.338048 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:48.338020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-88xbw_3065add7-670e-49e3-b2a7-15db8035d568/postgres/0.log" Jul 06 23:05:49.890585 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:49.890480 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67b7b4db78-7tfjj_4e93aedf-25b3-44a0-b828-706ebb18c8c4/manager/0.log" Jul 06 23:05:49.945191 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:49.945160 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z6ph9_fdea8107-dc78-4763-a5dc-69dfbb5c1c86/openshift-lws-operator/0.log" Jul 06 23:05:50.398647 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:50.398618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/0.log" Jul 06 23:05:50.459341 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:50.459310 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/1.log" Jul 06 23:05:50.513373 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:50.513337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w76nr_0bf140be-577d-4730-aa6d-c06425bc168e/payload-processing/0.log" Jul 06 23:05:50.527483 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:50.527453 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b777fbb4c-rnppq_b0472d95-0970-4d8d-8adb-de2f7f9eb1e2/router/0.log" Jul 06 23:05:51.838082 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:51.838015 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/0.log" Jul 06 23:05:51.892530 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:51.892443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ngc6t_544976c9-5625-4109-b0a0-e07b5487fbb1/istio-proxy/1.log" Jul 06 23:05:51.948276 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:51.948239 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-w76nr_0bf140be-577d-4730-aa6d-c06425bc168e/payload-processing/0.log" Jul 06 23:05:51.971267 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:51.971235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b777fbb4c-rnppq_b0472d95-0970-4d8d-8adb-de2f7f9eb1e2/router/0.log" Jul 06 23:05:55.401000 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:55.400971 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x9v6b_50b581c5-2f6a-4705-9790-a309edac9cbe/kube-storage-version-migrator-operator/1.log" Jul 06 23:05:55.402655 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:55.402629 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x9v6b_50b581c5-2f6a-4705-9790-a309edac9cbe/kube-storage-version-migrator-operator/0.log" Jul 06 23:05:56.368156 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.368126 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/kube-multus-additional-cni-plugins/0.log" Jul 06 23:05:56.389788 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.389755 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/egress-router-binary-copy/0.log" Jul 06 23:05:56.420900 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.420865 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/cni-plugins/0.log" Jul 06 23:05:56.440531 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.440500 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/bond-cni-plugin/0.log" Jul 06 23:05:56.460997 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.460967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/routeoverride-cni/0.log" Jul 06 23:05:56.481482 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.481455 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/whereabouts-cni-bincopy/0.log" Jul 06 23:05:56.500881 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.500855 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bp7p4_97b6b946-f277-42dd-a372-ad3704a29af1/whereabouts-cni/0.log" Jul 06 23:05:56.710795 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.710694 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d2b4j_17ebd9ea-8a86-4dc5-a82c-237926a9f259/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:56.900977 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:56.900946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zlgxb_393e5b62-6995-4943-8506-df15f09c3afc/kube-multus/0.log" Jul 06 23:05:57.010988 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:57.010962 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vs77c_13808416-159f-475e-bfa8-00f2b0094637/network-metrics-daemon/0.log" Jul 06 23:05:57.026179 ip-10-0-138-135 kubenswrapper[2568]: I0706 23:05:57.026159 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vs77c_13808416-159f-475e-bfa8-00f2b0094637/kube-rbac-proxy/0.log"