Jul 02 11:35:37.386765 ip-10-0-134-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 11:35:37.386776 ip-10-0-134-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 11:35:37.386783 ip-10-0-134-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 11:35:37.387128 ip-10-0-134-102 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 11:35:46.524578 ip-10-0-134-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 11:35:46.524592 ip-10-0-134-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7ef6bd5cfa2d4003aea4f4933f49fdb6 -- Jul 02 11:37:16.184534 ip-10-0-134-102 systemd[1]: Starting Kubernetes Kubelet... Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.614821 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618414 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618423 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618429 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618433 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618436 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618440 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.622455 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618443 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618446 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618448 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618451 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618454 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618457 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618459 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618462 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618464 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618467 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618470 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618472 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618475 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618477 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618482 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618485 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618488 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618491 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618493 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618496 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.681916 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618499 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618502 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618505 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618507 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618510 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618512 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618515 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618517 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618520 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618522 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618525 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618527 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618530 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618532 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618535 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618537 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618540 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618542 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618546 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618548 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.684300 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618551 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618553 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618561 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618564 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618567 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618569 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618572 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618574 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618576 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618579 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618582 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618585 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618587 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618590 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618592 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618595 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618597 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618600 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618602 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618605 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.780363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618607 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618610 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618613 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618615 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618618 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618620 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618623 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618626 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618628 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618630 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618633 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618635 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618638 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618640 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618643 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618646 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618648 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618651 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618653 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618656 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.955605 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618658 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.714151 ip-10-0-134-102 systemd[1]: Started Kubernetes Kubelet. Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618661 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618663 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618666 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618670 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618672 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618675 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618677 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618679 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618682 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618684 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618689 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.618693 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620126 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620134 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620137 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620140 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620144 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620147 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.956558 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620151 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620153 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620156 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620158 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620161 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620164 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620166 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620169 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620172 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620176 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620179 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620182 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620185 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620188 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620191 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620194 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620197 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620199 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620202 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620204 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.960214 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620207 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620210 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620212 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620215 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620217 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620220 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620224 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620227 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620229 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620232 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620234 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620237 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620239 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620242 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620245 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620263 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620266 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620269 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620271 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620274 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.961063 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620276 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620280 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620283 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620285 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620288 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620290 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620293 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620296 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620298 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620302 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620304 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620307 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620310 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620312 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620315 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620317 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620320 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620322 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620326 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620329 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.963401 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620332 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620335 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620337 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620340 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620343 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620347 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620350 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620353 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620356 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620358 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620361 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620363 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620366 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620369 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620372 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620374 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620377 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620379 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620382 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.965684 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620385 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620387 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620390 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620392 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620396 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620399 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620402 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620405 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620408 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620410 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620413 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620416 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620419 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620421 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620792 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620796 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620799 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620802 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620804 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.968468 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620807 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620810 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620812 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620815 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620817 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620820 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620823 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620825 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620828 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620831 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620834 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620836 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620839 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620842 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620844 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620847 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620850 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620852 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620855 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620857 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.972521 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620860 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620863 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620865 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620868 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620871 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620874 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620876 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620879 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620882 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620884 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620887 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620889 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620892 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620895 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620897 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620899 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620902 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620904 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620907 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.973082 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620910 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620912 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620915 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620918 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620922 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620925 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620927 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620930 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620932 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620935 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620937 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620940 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620942 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620944 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620950 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620953 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620956 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620961 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620964 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.973650 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620967 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620970 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620973 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620976 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620979 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620983 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620986 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620989 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620992 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620994 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.620997 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621000 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621003 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621005 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621008 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621010 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621015 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621019 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621022 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.974162 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621024 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621027 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621029 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621032 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621035 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621037 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621040 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621042 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621045 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621047 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621050 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621053 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621056 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621058 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621061 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621063 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621066 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621133 2551 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621144 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621150 2551 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621154 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621158 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 11:37:16.974729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621161 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621166 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621170 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621173 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621176 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621180 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621183 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621186 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621191 2551 flags.go:64] FLAG: --cgroup-root="" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621194 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621197 2551 flags.go:64] FLAG: --client-ca-file="" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621200 2551 flags.go:64] FLAG: --cloud-provider="external" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621202 2551 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621207 2551 flags.go:64] FLAG: --cluster-domain="" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621209 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621212 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621215 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621219 2551 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621222 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621225 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621228 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621233 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621236 2551 flags.go:64] FLAG: --contention-profiling="false" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621239 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 11:37:16.975331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621242 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621258 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621261 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621265 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621268 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621271 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621274 2551 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621276 2551 flags.go:64] FLAG: --enable-server="true" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621279 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621283 2551 flags.go:64] FLAG: --event-burst="100" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621286 2551 flags.go:64] FLAG: --event-qps="50" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621289 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621292 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621295 2551 flags.go:64] FLAG: --eviction-hard="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621298 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621301 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621306 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621309 2551 flags.go:64] FLAG: --eviction-soft="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621313 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621315 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621318 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621321 2551 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621324 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621327 2551 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621329 2551 flags.go:64] FLAG: --feature-gates="" Jul 02 11:37:16.975969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621333 2551 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621336 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621338 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621341 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621346 2551 flags.go:64] FLAG: --healthz-port="10248" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621349 2551 flags.go:64] FLAG: --help="false" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621352 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621355 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621358 2551 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621360 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621364 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621367 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621370 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621372 2551 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621375 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621378 2551 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621381 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621384 2551 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621386 2551 flags.go:64] FLAG: --kube-reserved="" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621389 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621392 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621395 2551 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621398 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621402 2551 flags.go:64] FLAG: --lock-file="" Jul 02 11:37:16.976681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621405 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621408 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621411 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621416 2551 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621419 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621422 2551 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621424 2551 flags.go:64] FLAG: --logging-format="text" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621427 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621430 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621433 2551 flags.go:64] FLAG: --manifest-url="" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621436 2551 flags.go:64] FLAG: --manifest-url-header="" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621440 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621444 2551 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621448 2551 flags.go:64] FLAG: --max-pods="110" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621451 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621454 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621457 2551 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621460 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621462 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621465 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621468 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621475 2551 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621477 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621480 2551 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 11:37:16.977282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621483 2551 flags.go:64] FLAG: --pod-cidr="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621486 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621491 2551 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621494 2551 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621497 2551 flags.go:64] FLAG: --pods-per-core="0" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621500 2551 flags.go:64] FLAG: --port="10250" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621503 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621506 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-099b168ad6650db41" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621510 2551 flags.go:64] FLAG: --qos-reserved="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621513 2551 flags.go:64] FLAG: --read-only-port="10255" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621517 2551 flags.go:64] FLAG: --register-node="true" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621520 2551 flags.go:64] FLAG: --register-with-taints="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621523 2551 flags.go:64] FLAG: --registry-burst="10" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621526 2551 flags.go:64] FLAG: --registry-qps="5" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621529 2551 flags.go:64] FLAG: --reserved-cpus="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621532 2551 flags.go:64] FLAG: --reserved-memory="" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621535 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621538 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621541 2551 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621544 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621549 2551 flags.go:64] FLAG: --runonce="false" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621551 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621554 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621557 2551 flags.go:64] FLAG: --seccomp-default="false" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621560 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 11:37:16.977868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621563 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621566 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621569 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621572 2551 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621575 2551 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621578 2551 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621580 2551 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621583 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621586 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621589 2551 flags.go:64] FLAG: --system-cgroups="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621592 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621597 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621600 2551 flags.go:64] FLAG: --tls-cert-file="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621602 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621606 2551 flags.go:64] FLAG: --tls-min-version="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621610 2551 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621613 2551 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621616 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621620 2551 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621623 2551 flags.go:64] FLAG: --v="2" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621627 2551 flags.go:64] FLAG: --version="false" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621631 2551 flags.go:64] FLAG: --vmodule="" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621634 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.621638 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621745 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.978590 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621748 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621751 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621755 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621758 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621761 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621764 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621767 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621770 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621773 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621775 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621778 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621780 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621783 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621785 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621788 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621790 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621793 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621795 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621798 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621800 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.979264 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621803 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621805 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621810 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621812 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621815 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621817 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621821 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621825 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621828 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621831 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621834 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621837 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621839 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621842 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621846 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621848 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621850 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621853 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621856 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.979754 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621858 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621861 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621863 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621867 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621870 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621873 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621876 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621878 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621881 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621883 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621886 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621888 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621891 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621893 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621896 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621901 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621904 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621907 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621910 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621912 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.980223 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621915 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621917 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621920 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621923 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621925 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621928 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621930 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621935 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621938 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621940 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621942 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621945 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621947 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621950 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621952 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621955 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621958 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621960 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621963 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.980727 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621965 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621968 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621971 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621973 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621975 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621978 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621980 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621983 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621987 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621990 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621992 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621995 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.621997 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622000 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622003 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622006 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622008 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622011 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622013 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.981185 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.622017 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.622586 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.628873 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.628887 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.630115 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.630122 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630177 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630182 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630186 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630189 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630192 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630195 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630198 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630200 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630203 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.981656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630206 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630208 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630211 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630214 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630217 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630219 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630222 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630224 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630227 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630230 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630233 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630235 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630240 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630243 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630261 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630265 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630268 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630270 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630273 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630275 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.982034 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630279 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630283 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630285 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630288 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630291 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630293 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630296 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630298 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630300 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630303 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630305 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630308 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630310 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630313 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630315 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630318 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630320 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630323 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630325 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630328 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.982534 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630330 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630333 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630335 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630338 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630340 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630342 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630345 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630347 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630350 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630352 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630355 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630357 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630361 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630364 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630367 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630370 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630372 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630375 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630377 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630380 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.983038 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630382 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630384 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630387 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630390 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630392 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630395 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630397 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630400 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630402 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630404 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630407 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630409 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630412 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630416 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630419 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630422 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630425 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630428 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630430 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.983546 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630433 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630436 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630438 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630442 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630446 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630451 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630454 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630457 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630460 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630463 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630465 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.630470 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630582 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630586 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 11:37:16.983998 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630590 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630594 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630597 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630600 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630603 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630606 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630609 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630612 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630616 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630619 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630622 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630624 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630627 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630629 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630632 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630634 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630637 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630639 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630642 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 11:37:16.984374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630645 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630648 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630651 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630653 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630657 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630659 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630662 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630665 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630668 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630670 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630672 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630675 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630677 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630680 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630682 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630685 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630687 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630690 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630692 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630695 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 11:37:16.984827 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630697 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630700 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630702 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630704 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630707 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630709 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630711 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630715 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630719 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630722 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630724 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630727 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630730 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630733 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630735 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630738 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630742 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630745 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630747 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630750 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 11:37:16.985317 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630753 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630755 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630758 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630760 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630763 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630765 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630767 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630770 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630772 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630775 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630777 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630780 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630782 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630785 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630787 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630790 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630792 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630795 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630797 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630807 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 11:37:16.985800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630810 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630813 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630816 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630818 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630821 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630824 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630826 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630828 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630832 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630835 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630838 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630840 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630843 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630846 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630849 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630851 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630854 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 11:37:16.986301 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:16.630856 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.630861 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.630954 2551 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.632854 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.634268 2551 server.go:1019] "Starting client certificate rotation" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.636907 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.640875 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.649232 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.649708 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.675073 2551 log.go:25] "Validated CRI v1 runtime API" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.683666 2551 log.go:25] "Validated CRI v1 image API" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.684518 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 11:37:16.986708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.688823 2551 fs.go:135] Filesystem UUIDs: map[79d1e8e7-0db8-4312-a328-b7ebf82d3ef7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 80cbdff4-f695-40a9-b09f-db6f964bdf92:/dev/nvme0n1p4] Jul 02 11:37:16.987010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.688837 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 11:37:16.987010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.692224 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.694260 2551 manager.go:216] Machine: {Timestamp:2026-07-02 11:37:16.692876902 +0000 UTC m=+0.386912017 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3067402 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec282b88d384e2a48eeb1a9f3bea4f1f SystemUUID:ec282b88-d384-e2a4-8eeb-1a9f3bea4f1f BootID:7ef6bd5c-fa2d-4003-aea4-f4933f49fdb6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:28:21:16:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:28:21:16:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:2a:23:2e:77:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.694365 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.694435 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.697403 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.697424 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.698819 2551 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.698830 2551 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.698837 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.699422 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.700290 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703474 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703578 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703604 2551 kubelet.go:486] "Attempting to sync node with API server" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703612 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703626 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703636 2551 kubelet.go:398] "Adding apiserver pod source" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703644 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 11:37:16.987069 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703953 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.703970 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.707218 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.708565 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.708592 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709231 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709244 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709269 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709274 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709290 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709295 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709302 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709307 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709314 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709320 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709328 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.709332 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.710037 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.710043 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.713208 2551 server.go:1268] "Started kubelet" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.713684 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.713733 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.713789 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.713838 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.714056 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.714169 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.715464 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.716782 2551 server.go:310] "Adding debug handlers to kubelet server" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.719809 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.720171 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18be75fe1a918bee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-02 11:37:16.713184238 +0000 UTC m=+0.407219356,LastTimestamp:2026-07-02 11:37:16.713184238 +0000 UTC m=+0.407219356,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.722923 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.722941 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.723035 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723495 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723557 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723575 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723819 2551 reconstruct.go:97] "Volume reconstruction finished" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723832 2551 reconciler.go:29] "Reconciler: start to sync state" Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723885 2551 factory.go:55] Registering systemd factory Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.723902 2551 factory.go:223] Registration of the systemd container factory successfully Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.725658 2551 factory.go:153] Registering CRI-O factory Jul 02 11:37:16.987576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.725673 2551 factory.go:223] Registration of the crio container factory successfully Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.725733 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.725761 2551 factory.go:103] Registering Raw factory Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.725778 2551 manager.go:1196] Started watching for new ooms in manager Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.726143 2551 manager.go:349] Starting recovery of all containers Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.734733 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.734792 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.737155 2551 manager.go:354] Recovery completed Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.741789 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744029 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744059 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744068 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744549 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744559 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744577 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.744611 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.745244 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.745287 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.745305 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.745843 2551 policy_none.go:49] "None policy: Start" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.747298 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.747315 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.747351 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c9q2t" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.748522 2551 policy_none.go:47] "Start" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.758068 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c9q2t" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.758796 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-102.ec2.internal.18be75fe1c6869a1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-102.ec2.internal,UID:ip-10-0-134-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-102.ec2.internal,},FirstTimestamp:2026-07-02 11:37:16.744042913 +0000 UTC m=+0.438078029,LastTimestamp:2026-07-02 11:37:16.744042913 +0000 UTC m=+0.438078029,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-102.ec2.internal,}" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.797901 2551 manager.go:337] "Starting Device Plugin manager" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.797932 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.797943 2551 server.go:87] "Starting device plugin registration server" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.798194 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.798207 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.798299 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.798396 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.798404 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.798908 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.798960 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.809902 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.811099 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.811135 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 11:37:16.988599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.811155 2551 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.811186 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.813981 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.898930 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.899720 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.899747 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.899758 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.899780 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.909274 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.909299 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-102.ec2.internal\": node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.911928 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal"] Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.911976 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.912687 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.912705 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.912718 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.913999 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914099 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914126 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914650 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914670 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914677 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914691 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914701 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.914692 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.915774 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.915800 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.916427 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.916454 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.916464 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.925313 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.925334 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:16.925352 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67cd314639f46c104191661c02cd9b02-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"67cd314639f46c104191661c02cd9b02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.930759 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-102.ec2.internal\" not found" node="ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.989597 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.935037 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-102.ec2.internal\" not found" node="ip-10-0-134-102.ec2.internal" Jul 02 11:37:16.990447 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:16.947591 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.025895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025874 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.025975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025906 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.025975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025924 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67cd314639f46c104191661c02cd9b02-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"67cd314639f46c104191661c02cd9b02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.025975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025937 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.025975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025956 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67cd314639f46c104191661c02cd9b02-config\") pod \"kube-apiserver-proxy-ip-10-0-134-102.ec2.internal\" (UID: \"67cd314639f46c104191661c02cd9b02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.026089 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.025975 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/543120c32551afd3c62e5d553d438de2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal\" (UID: \"543120c32551afd3c62e5d553d438de2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.048388 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.048374 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.149386 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.149364 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.233952 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.233910 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.238866 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.238849 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.249856 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.249841 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.350330 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.350290 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.450825 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.450790 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-102.ec2.internal\" not found" Jul 02 11:37:17.520904 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.520889 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:17.523575 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.523556 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.538893 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.538876 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 11:37:17.541207 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.541195 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" Jul 02 11:37:17.548713 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.548695 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 11:37:17.619406 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.618024 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:17.642536 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.642505 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 11:37:17.642924 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.642633 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 11:37:17.642924 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.642674 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 11:37:17.704416 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.704374 2551 apiserver.go:52] "Watching apiserver" Jul 02 11:37:17.714679 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.714655 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 11:37:17.715031 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.715008 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kphz6","kube-system/konnectivity-agent-dfwwd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2","openshift-cluster-node-tuning-operator/tuned-n5mfc","openshift-dns/node-resolver-gjt77","openshift-network-diagnostics/network-check-target-c226k","openshift-network-operator/iptables-alerter-lbfnl","kube-system/global-pull-secret-syncer-s6l45","kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal","openshift-image-registry/node-ca-fktrt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal","openshift-multus/multus-99h8m","openshift-multus/multus-additional-cni-plugins-46qn8","openshift-multus/network-metrics-daemon-glt4f"] Jul 02 11:37:17.716728 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.716698 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.718160 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.718139 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.719108 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719089 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 11:37:17.719205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719095 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.719459 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719442 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 11:37:17.719589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719474 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.719664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719590 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.719664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.719620 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gp99s\"" Jul 02 11:37:17.720716 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.720695 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 11:37:17.720787 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.720748 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vqzt8\"" Jul 02 11:37:17.720787 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.720705 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 11:37:17.720968 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.720955 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.722138 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.722119 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbb77\"" Jul 02 11:37:17.722225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.722154 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.722225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.722182 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 11:37:17.722313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.722293 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.722413 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.722396 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.723093 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.723077 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 11:37:17.723374 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.723354 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.723442 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.723418 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.723530 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.723513 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t8n2c\"" Jul 02 11:37:17.723801 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.723787 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:17.723860 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.723843 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:17.725238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.725218 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.725606 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.725539 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.726235 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.726210 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vd57p\"" Jul 02 11:37:17.727048 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.727028 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:17.727500 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.727475 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.728189 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.727956 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.728189 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.728095 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kxsdb\"" Jul 02 11:37:17.728189 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.728126 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:17.728425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.728265 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 11:37:17.729010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.728959 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.729323 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729292 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 11:37:17.729424 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729298 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 11:37:17.729424 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-kubernetes\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.729798 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729774 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75246532-adc3-4159-9287-424e7ce1f540-hosts-file\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.729874 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729830 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-netns\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.729874 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729865 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-hostroot\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.729973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.729973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729941 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-conf\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730097 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.729998 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qch7\" (UniqueName: \"kubernetes.io/projected/e615272a-f2a4-495f-8737-24c51c0db6d6-kube-api-access-5qch7\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730097 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730033 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-os-release\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.730097 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730059 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-conf-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.730097 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730093 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-tuned\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wfh\" (UniqueName: \"kubernetes.io/projected/4a830ed0-5015-4c8c-9570-f33c7f61e622-kube-api-access-b5wfh\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730166 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-os-release\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730198 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730231 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktp4\" (UniqueName: \"kubernetes.io/projected/39ffdf1b-e9ed-46e8-904c-6a374390f553-kube-api-access-gktp4\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730248 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-run\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730270 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-lib-modules\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-system-cni-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730337 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-modprobe-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730380 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730396 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730398 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysconfig\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730445 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-cni-binary-copy\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-kubelet\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730567 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730573 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-multus-certs\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730611 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-cnibin\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730634 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a830ed0-5015-4c8c-9570-f33c7f61e622-host-slash\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730689 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-sys\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.730734 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730720 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-tmp\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730747 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rkbf\" (UniqueName: \"kubernetes.io/projected/75246532-adc3-4159-9287-424e7ce1f540-kube-api-access-6rkbf\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730772 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-k8s-cni-cncf-io\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730814 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-bin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730843 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-daemon-config\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730903 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-var-lib-kubelet\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730927 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-multus\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730951 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-binary-copy\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.730975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a830ed0-5015-4c8c-9570-f33c7f61e622-iptables-alerter-script\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731053 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-systemd\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731114 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75246532-adc3-4159-9287-424e7ce1f540-tmp-dir\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731138 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-cnibin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731163 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-host\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731188 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-system-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731224 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731977 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731283 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-socket-dir-parent\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731977 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731310 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-etc-kubernetes\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.731977 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.731333 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdm55\" (UniqueName: \"kubernetes.io/projected/d695493a-259d-42cd-adc7-e70cfa7249d8-kube-api-access-fdm55\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.732901 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.732879 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.733007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.732931 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.733298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.733281 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-48kfq\"" Jul 02 11:37:17.733458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.733442 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.733625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.733610 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 11:37:17.735097 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.734867 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 11:37:17.735293 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.735279 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 11:37:17.735812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.735567 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 11:37:17.735812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.735578 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.735812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.735610 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 11:37:17.736067 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.735832 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7qx49\"" Jul 02 11:37:17.738150 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.738130 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 11:37:17.738246 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.738198 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 11:37:17.738310 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.738301 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rgk5p\"" Jul 02 11:37:17.738389 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.738338 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.738437 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.738401 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:17.757882 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.757836 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5zrd" Jul 02 11:37:17.765009 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.764950 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 11:32:16 +0000 UTC" deadline="2027-12-10 18:21:46.763239468 +0000 UTC" Jul 02 11:37:17.765136 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.765009 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12630h44m28.998234258s" Jul 02 11:37:17.767648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.767631 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g5zrd" Jul 02 11:37:17.826722 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.825519 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 11:37:17.832253 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832228 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e14d2846-31ec-44d9-946c-07a3c0a394c6-konnectivity-ca\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.832371 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832269 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdb8f142-1572-40d8-b293-5b4019ed156f-ovn-node-metrics-cert\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.832371 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832302 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-system-cni-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.832371 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832346 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-modprobe-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832396 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysconfig\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832429 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832404 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-system-cni-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832448 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-kubelet\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832475 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysconfig\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832496 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-kubelet\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832496 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-modprobe-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.832513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832500 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-multus-certs\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832531 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-kubelet\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832546 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-multus-certs\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-systemd-units\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-cnibin\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832594 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rkbf\" (UniqueName: \"kubernetes.io/projected/75246532-adc3-4159-9287-424e7ce1f540-kube-api-access-6rkbf\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832609 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-bin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832632 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-daemon-config\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832654 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-cnibin\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832668 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-dbus\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832678 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-bin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832691 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-socket-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832724 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-registration-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832754 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832781 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-var-lib-kubelet\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-multus\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832833 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-systemd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.832851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-var-lib-kubelet\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-netd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832871 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-var-lib-cni-multus\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832950 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-binary-copy\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.832982 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833011 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833038 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-var-lib-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833133 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-d\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833191 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-etc-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833220 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-host\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833225 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-daemon-config\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833244 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-system-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833282 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-socket-dir-parent\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833335 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-system-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833350 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-host\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833275 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833311 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-host\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.833690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833399 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-kubernetes\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833403 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-socket-dir-parent\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-hostroot\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833434 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-log-socket\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833437 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-binary-copy\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833458 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833471 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-kubernetes\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833480 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-hostroot\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-script-lib\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833509 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833532 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-conf\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833548 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qch7\" (UniqueName: \"kubernetes.io/projected/e615272a-f2a4-495f-8737-24c51c0db6d6-kube-api-access-5qch7\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833562 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-os-release\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-conf-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833593 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-node-log\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833609 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-tuned\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833623 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-sysctl-conf\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.834551 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833628 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wfh\" (UniqueName: \"kubernetes.io/projected/4a830ed0-5015-4c8c-9570-f33c7f61e622-kube-api-access-b5wfh\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833667 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833695 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-run\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833697 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-os-release\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833701 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-conf-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833718 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-lib-modules\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833756 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-cni-binary-copy\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833781 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-run\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833790 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833821 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wlnf\" (UniqueName: \"kubernetes.io/projected/80c775cb-50d6-42d4-a9f5-3382b6d9f094-kube-api-access-9wlnf\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833846 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-slash\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833858 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833901 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-serviceca\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833941 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a830ed0-5015-4c8c-9570-f33c7f61e622-host-slash\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833965 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-lib-modules\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833963 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833965 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-sys\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834013 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a830ed0-5015-4c8c-9570-f33c7f61e622-host-slash\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834022 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-tmp\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834048 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-k8s-cni-cncf-io\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.833983 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/39ffdf1b-e9ed-46e8-904c-6a374390f553-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834064 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-sys\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-kubelet-config\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834114 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-k8s-cni-cncf-io\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834134 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-env-overrides\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834157 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwrww\" (UniqueName: \"kubernetes.io/projected/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-kube-api-access-hwrww\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834185 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a830ed0-5015-4c8c-9570-f33c7f61e622-iptables-alerter-script\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834216 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-systemd\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834227 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d695493a-259d-42cd-adc7-e70cfa7249d8-cni-binary-copy\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834242 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75246532-adc3-4159-9287-424e7ce1f540-tmp-dir\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834281 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-cnibin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834298 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-systemd\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834309 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf64p\" (UniqueName: \"kubernetes.io/projected/cdb8f142-1572-40d8-b293-5b4019ed156f-kube-api-access-jf64p\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.835872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834339 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834353 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-cnibin\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834363 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-etc-kubernetes\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834391 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdm55\" (UniqueName: \"kubernetes.io/projected/d695493a-259d-42cd-adc7-e70cfa7249d8-kube-api-access-fdm55\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834416 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-etc-kubernetes\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834418 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834464 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e14d2846-31ec-44d9-946c-07a3c0a394c6-agent-certs\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834533 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-multus-cni-dir\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834558 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75246532-adc3-4159-9287-424e7ce1f540-tmp-dir\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834658 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-ovn\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-bin\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834718 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75246532-adc3-4159-9287-424e7ce1f540-hosts-file\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834746 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-netns\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834790 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d695493a-259d-42cd-adc7-e70cfa7249d8-host-run-netns\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834806 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75246532-adc3-4159-9287-424e7ce1f540-hosts-file\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834820 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a830ed0-5015-4c8c-9570-f33c7f61e622-iptables-alerter-script\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834830 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-sys-fs\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.836404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834898 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-config\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834935 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrppk\" (UniqueName: \"kubernetes.io/projected/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kube-api-access-rrppk\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834964 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-netns\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.834992 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-os-release\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.835020 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gktp4\" (UniqueName: \"kubernetes.io/projected/39ffdf1b-e9ed-46e8-904c-6a374390f553-kube-api-access-gktp4\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.835045 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-device-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.836976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.835078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39ffdf1b-e9ed-46e8-904c-6a374390f553-os-release\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.837157 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.837119 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-etc-tuned\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.837190 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.837151 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e615272a-f2a4-495f-8737-24c51c0db6d6-tmp\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.839331 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.839304 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:17.839376 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.839336 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:17.839376 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.839347 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:17.839445 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.839392 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:18.339377825 +0000 UTC m=+2.033412930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:17.841511 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.841492 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rkbf\" (UniqueName: \"kubernetes.io/projected/75246532-adc3-4159-9287-424e7ce1f540-kube-api-access-6rkbf\") pod \"node-resolver-gjt77\" (UID: \"75246532-adc3-4159-9287-424e7ce1f540\") " pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:17.842802 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.842774 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wfh\" (UniqueName: \"kubernetes.io/projected/4a830ed0-5015-4c8c-9570-f33c7f61e622-kube-api-access-b5wfh\") pod \"iptables-alerter-lbfnl\" (UID: \"4a830ed0-5015-4c8c-9570-f33c7f61e622\") " pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:17.843085 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.843068 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdm55\" (UniqueName: \"kubernetes.io/projected/d695493a-259d-42cd-adc7-e70cfa7249d8-kube-api-access-fdm55\") pod \"multus-99h8m\" (UID: \"d695493a-259d-42cd-adc7-e70cfa7249d8\") " pod="openshift-multus/multus-99h8m" Jul 02 11:37:17.844237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.844217 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qch7\" (UniqueName: \"kubernetes.io/projected/e615272a-f2a4-495f-8737-24c51c0db6d6-kube-api-access-5qch7\") pod \"tuned-n5mfc\" (UID: \"e615272a-f2a4-495f-8737-24c51c0db6d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:17.844516 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.844498 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktp4\" (UniqueName: \"kubernetes.io/projected/39ffdf1b-e9ed-46e8-904c-6a374390f553-kube-api-access-gktp4\") pod \"multus-additional-cni-plugins-46qn8\" (UID: \"39ffdf1b-e9ed-46e8-904c-6a374390f553\") " pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:17.913923 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:17.913899 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543120c32551afd3c62e5d553d438de2.slice/crio-f122b453e5807e8453a7e59996b872645b50c1333734bbe73bb5466ea692aa46 WatchSource:0}: Error finding container f122b453e5807e8453a7e59996b872645b50c1333734bbe73bb5466ea692aa46: Status 404 returned error can't find the container with id f122b453e5807e8453a7e59996b872645b50c1333734bbe73bb5466ea692aa46 Jul 02 11:37:17.914786 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:17.914774 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67cd314639f46c104191661c02cd9b02.slice/crio-06423f76fa80000007240712159c280ca96bb130836a0f8d25d84cccd8ec980c WatchSource:0}: Error finding container 06423f76fa80000007240712159c280ca96bb130836a0f8d25d84cccd8ec980c: Status 404 returned error can't find the container with id 06423f76fa80000007240712159c280ca96bb130836a0f8d25d84cccd8ec980c Jul 02 11:37:17.920377 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.920359 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 11:37:17.935364 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935341 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-device-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.935449 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935368 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e14d2846-31ec-44d9-946c-07a3c0a394c6-konnectivity-ca\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.935449 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935385 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdb8f142-1572-40d8-b293-5b4019ed156f-ovn-node-metrics-cert\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935449 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935412 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-kubelet\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935449 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935431 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-systemd-units\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-dbus\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935470 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-device-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935477 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-socket-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935491 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-systemd-units\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935508 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-kubelet\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935533 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-registration-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935577 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-dbus\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935576 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-systemd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935622 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-netd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.935627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935625 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-systemd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935644 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935647 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-registration-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935662 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-var-lib-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935584 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-socket-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935675 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-netd\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935696 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-var-lib-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935700 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-etc-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.935810 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935832 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-etc-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935842 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-host\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.935871 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:18.435851601 +0000 UTC m=+2.129886726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-host\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935926 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-log-socket\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935955 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.935972 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e14d2846-31ec-44d9-946c-07a3c0a394c6-konnectivity-ca\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936005 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936063 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-log-socket\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936092 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-script-lib\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936135 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-node-log\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936155 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936179 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wlnf\" (UniqueName: \"kubernetes.io/projected/80c775cb-50d6-42d4-a9f5-3382b6d9f094-kube-api-access-9wlnf\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936207 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-node-log\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936211 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-slash\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936251 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936295 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-serviceca\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936302 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936307 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-slash\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936321 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-kubelet-config\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936340 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936376 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e29da5ba-f670-4597-bae8-8be15b820916-kubelet-config\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936410 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936444 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-env-overrides\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.936516 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:17.936951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936515 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwrww\" (UniqueName: \"kubernetes.io/projected/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-kube-api-access-hwrww\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:17.936568 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:18.436550033 +0000 UTC m=+2.130585141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936603 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf64p\" (UniqueName: \"kubernetes.io/projected/cdb8f142-1572-40d8-b293-5b4019ed156f-kube-api-access-jf64p\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936638 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936663 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e14d2846-31ec-44d9-946c-07a3c0a394c6-agent-certs\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936688 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936708 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-script-lib\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936719 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-ovn\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936747 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-bin\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936775 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-sys-fs\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936789 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-serviceca\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936791 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936785 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-ovn\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-run-openvswitch\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936821 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-config\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936963 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-env-overrides\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.937560 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936963 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrppk\" (UniqueName: \"kubernetes.io/projected/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kube-api-access-rrppk\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.936966 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-cni-bin\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.937023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-sys-fs\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.937102 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-netns\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.937189 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cdb8f142-1572-40d8-b293-5b4019ed156f-host-run-netns\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.937469 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cdb8f142-1572-40d8-b293-5b4019ed156f-ovnkube-config\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.938057 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cdb8f142-1572-40d8-b293-5b4019ed156f-ovn-node-metrics-cert\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.939112 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.939092 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e14d2846-31ec-44d9-946c-07a3c0a394c6-agent-certs\") pod \"konnectivity-agent-dfwwd\" (UID: \"e14d2846-31ec-44d9-946c-07a3c0a394c6\") " pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:17.948181 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.948154 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wlnf\" (UniqueName: \"kubernetes.io/projected/80c775cb-50d6-42d4-a9f5-3382b6d9f094-kube-api-access-9wlnf\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:17.948397 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.948381 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrppk\" (UniqueName: \"kubernetes.io/projected/e1ded74e-15c3-4a09-afc0-ba6fa0b58d24-kube-api-access-rrppk\") pod \"aws-ebs-csi-driver-node-rqdn2\" (UID: \"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:17.949253 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.949236 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf64p\" (UniqueName: \"kubernetes.io/projected/cdb8f142-1572-40d8-b293-5b4019ed156f-kube-api-access-jf64p\") pod \"ovnkube-node-kphz6\" (UID: \"cdb8f142-1572-40d8-b293-5b4019ed156f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:17.949434 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:17.949419 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwrww\" (UniqueName: \"kubernetes.io/projected/a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf-kube-api-access-hwrww\") pod \"node-ca-fktrt\" (UID: \"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf\") " pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:18.040671 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.040646 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-99h8m" Jul 02 11:37:18.050095 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.050076 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd695493a_259d_42cd_adc7_e70cfa7249d8.slice/crio-f82e3654838123f261a571e8e7f16a289d1bd7640333cebb10031ddab50da254 WatchSource:0}: Error finding container f82e3654838123f261a571e8e7f16a289d1bd7640333cebb10031ddab50da254: Status 404 returned error can't find the container with id f82e3654838123f261a571e8e7f16a289d1bd7640333cebb10031ddab50da254 Jul 02 11:37:18.053141 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.053117 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46qn8" Jul 02 11:37:18.061348 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.061330 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ffdf1b_e9ed_46e8_904c_6a374390f553.slice/crio-c39da342e9e7c07c88016422c1c4ad01becbb24cc4042a72d46cf0c69995426c WatchSource:0}: Error finding container c39da342e9e7c07c88016422c1c4ad01becbb24cc4042a72d46cf0c69995426c: Status 404 returned error can't find the container with id c39da342e9e7c07c88016422c1c4ad01becbb24cc4042a72d46cf0c69995426c Jul 02 11:37:18.067117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.067102 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbfnl" Jul 02 11:37:18.074763 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.074735 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a830ed0_5015_4c8c_9570_f33c7f61e622.slice/crio-00e88ab45b949aade0fd1f4c558ac739164932a75af1bae4012f09eddcc3167c WatchSource:0}: Error finding container 00e88ab45b949aade0fd1f4c558ac739164932a75af1bae4012f09eddcc3167c: Status 404 returned error can't find the container with id 00e88ab45b949aade0fd1f4c558ac739164932a75af1bae4012f09eddcc3167c Jul 02 11:37:18.078757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.078741 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" Jul 02 11:37:18.086743 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.086722 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode615272a_f2a4_495f_8737_24c51c0db6d6.slice/crio-8354b4f4e95c9196bb1b191184954542566320982fb6ff8cbb89c21866718058 WatchSource:0}: Error finding container 8354b4f4e95c9196bb1b191184954542566320982fb6ff8cbb89c21866718058: Status 404 returned error can't find the container with id 8354b4f4e95c9196bb1b191184954542566320982fb6ff8cbb89c21866718058 Jul 02 11:37:18.093328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.093298 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjt77" Jul 02 11:37:18.100920 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.100899 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75246532_adc3_4159_9287_424e7ce1f540.slice/crio-bb621bbf67593378f706ee2b883184d482746acd76c157cc23296ebf6b50ba00 WatchSource:0}: Error finding container bb621bbf67593378f706ee2b883184d482746acd76c157cc23296ebf6b50ba00: Status 404 returned error can't find the container with id bb621bbf67593378f706ee2b883184d482746acd76c157cc23296ebf6b50ba00 Jul 02 11:37:18.108210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.108191 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:18.116196 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.116176 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb8f142_1572_40d8_b293_5b4019ed156f.slice/crio-4cae7afb8cf6abd5907ed5c3372bf24acd8e3cb24f018e52f5b805cfd6707b08 WatchSource:0}: Error finding container 4cae7afb8cf6abd5907ed5c3372bf24acd8e3cb24f018e52f5b805cfd6707b08: Status 404 returned error can't find the container with id 4cae7afb8cf6abd5907ed5c3372bf24acd8e3cb24f018e52f5b805cfd6707b08 Jul 02 11:37:18.122282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.122267 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fktrt" Jul 02 11:37:18.130363 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.130341 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8741aaf_5c14_4b9f_a2f2_bf27a6fdb0bf.slice/crio-f9656a1f3ce530a97c1de8e18298294123fc1026f23d55930522f2f5cfd58673 WatchSource:0}: Error finding container f9656a1f3ce530a97c1de8e18298294123fc1026f23d55930522f2f5cfd58673: Status 404 returned error can't find the container with id f9656a1f3ce530a97c1de8e18298294123fc1026f23d55930522f2f5cfd58673 Jul 02 11:37:18.143754 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.143737 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" Jul 02 11:37:18.152609 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.152582 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ded74e_15c3_4a09_afc0_ba6fa0b58d24.slice/crio-688931f9447a87f54477461ebaf6b0d9516e3e0866b0e4ba19306f109a2db10c WatchSource:0}: Error finding container 688931f9447a87f54477461ebaf6b0d9516e3e0866b0e4ba19306f109a2db10c: Status 404 returned error can't find the container with id 688931f9447a87f54477461ebaf6b0d9516e3e0866b0e4ba19306f109a2db10c Jul 02 11:37:18.153237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.153222 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:18.162198 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:18.162178 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14d2846_31ec_44d9_946c_07a3c0a394c6.slice/crio-8659991695b05b48baee956ff1f6acf79a68e668d033c9fea0d60cbf637d2006 WatchSource:0}: Error finding container 8659991695b05b48baee956ff1f6acf79a68e668d033c9fea0d60cbf637d2006: Status 404 returned error can't find the container with id 8659991695b05b48baee956ff1f6acf79a68e668d033c9fea0d60cbf637d2006 Jul 02 11:37:18.341192 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.341139 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:18.341307 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.341297 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:18.341360 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.341313 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:18.341360 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.341323 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:18.341426 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.341365 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:19.341352104 +0000 UTC m=+3.035387208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:18.442396 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.442368 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:18.442514 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.442408 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:18.442514 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.442502 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:18.442514 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.442505 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:18.442634 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.442545 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:19.442533279 +0000 UTC m=+3.136568383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:18.442634 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.442558 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:19.442552401 +0000 UTC m=+3.136587505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:18.772475 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.772409 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 11:32:17 +0000 UTC" deadline="2028-01-06 04:35:27.664799637 +0000 UTC" Jul 02 11:37:18.772475 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.772468 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13264h58m8.892336313s" Jul 02 11:37:18.794486 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.794440 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:18.812790 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.812352 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:18.812790 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:18.812465 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:18.832567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.832030 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfwwd" event={"ID":"e14d2846-31ec-44d9-946c-07a3c0a394c6","Type":"ContainerStarted","Data":"8659991695b05b48baee956ff1f6acf79a68e668d033c9fea0d60cbf637d2006"} Jul 02 11:37:18.841355 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.841222 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" event={"ID":"e615272a-f2a4-495f-8737-24c51c0db6d6","Type":"ContainerStarted","Data":"8354b4f4e95c9196bb1b191184954542566320982fb6ff8cbb89c21866718058"} Jul 02 11:37:18.848211 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.848179 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbfnl" event={"ID":"4a830ed0-5015-4c8c-9570-f33c7f61e622","Type":"ContainerStarted","Data":"00e88ab45b949aade0fd1f4c558ac739164932a75af1bae4012f09eddcc3167c"} Jul 02 11:37:18.859914 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.856691 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerStarted","Data":"c39da342e9e7c07c88016422c1c4ad01becbb24cc4042a72d46cf0c69995426c"} Jul 02 11:37:18.859914 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.859143 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99h8m" event={"ID":"d695493a-259d-42cd-adc7-e70cfa7249d8","Type":"ContainerStarted","Data":"f82e3654838123f261a571e8e7f16a289d1bd7640333cebb10031ddab50da254"} Jul 02 11:37:18.860725 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.860702 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" event={"ID":"67cd314639f46c104191661c02cd9b02","Type":"ContainerStarted","Data":"06423f76fa80000007240712159c280ca96bb130836a0f8d25d84cccd8ec980c"} Jul 02 11:37:18.862415 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.862392 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"543120c32551afd3c62e5d553d438de2","Type":"ContainerStarted","Data":"f122b453e5807e8453a7e59996b872645b50c1333734bbe73bb5466ea692aa46"} Jul 02 11:37:18.864987 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.864965 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" event={"ID":"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24","Type":"ContainerStarted","Data":"688931f9447a87f54477461ebaf6b0d9516e3e0866b0e4ba19306f109a2db10c"} Jul 02 11:37:18.868121 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.868093 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fktrt" event={"ID":"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf","Type":"ContainerStarted","Data":"f9656a1f3ce530a97c1de8e18298294123fc1026f23d55930522f2f5cfd58673"} Jul 02 11:37:18.869690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.869664 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"4cae7afb8cf6abd5907ed5c3372bf24acd8e3cb24f018e52f5b805cfd6707b08"} Jul 02 11:37:18.875318 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:18.875271 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjt77" event={"ID":"75246532-adc3-4159-9287-424e7ce1f540","Type":"ContainerStarted","Data":"bb621bbf67593378f706ee2b883184d482746acd76c157cc23296ebf6b50ba00"} Jul 02 11:37:19.350120 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.349518 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:19.350120 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.349689 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:19.350120 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.349708 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:19.350120 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.349721 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:19.350120 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.349776 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:21.349759064 +0000 UTC m=+5.043794170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:19.450532 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.450493 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:19.450713 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.450582 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:19.450713 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.450703 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:19.450828 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.450768 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:21.450751533 +0000 UTC m=+5.144786640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:19.451160 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.451138 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:19.451273 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.451197 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:21.451181678 +0000 UTC m=+5.145216783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:19.713166 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.712832 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 11:37:19.773222 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.773172 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 11:32:17 +0000 UTC" deadline="2028-01-30 12:57:03.764812689 +0000 UTC" Jul 02 11:37:19.773222 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.773207 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13849h19m43.991609156s" Jul 02 11:37:19.812319 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.811659 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:19.812319 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.811806 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:19.812319 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:19.811897 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:19.812319 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:19.811980 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:20.814050 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:20.814018 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:20.814539 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:20.814149 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:21.368825 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:21.368719 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:21.369005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.368874 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:21.369005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.368898 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:21.369005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.368912 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:21.369005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.368970 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:25.368951834 +0000 UTC m=+9.062986940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:21.469560 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:21.469649 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.469780 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.469841 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:25.469823167 +0000 UTC m=+9.163858273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.469930 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:21.470315 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.469969 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:25.469957028 +0000 UTC m=+9.163992132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:21.811807 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:21.811692 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:21.812018 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.811839 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:21.812018 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:21.811895 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:21.812018 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:21.811999 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:22.813115 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:22.813075 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:22.813633 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:22.813207 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:23.811915 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:23.811884 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:23.812100 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:23.812002 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:23.812100 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:23.812072 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:23.812232 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:23.812191 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:24.812587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:24.812093 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:24.812587 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:24.812218 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:25.399749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:25.399696 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:25.399921 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.399783 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:25.399921 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.399805 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:25.399921 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.399818 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:25.399921 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.399884 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:33.399865357 +0000 UTC m=+17.093900463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:25.500689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:25.500642 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:25.500854 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:25.500707 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:25.500854 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.500830 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:25.500971 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.500913 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:33.500890484 +0000 UTC m=+17.194925635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:25.500971 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.500838 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:25.501072 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.500978 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:33.500965495 +0000 UTC m=+17.195000598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:25.812290 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:25.812242 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:25.812482 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.812406 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:25.812482 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:25.812453 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:25.812592 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:25.812537 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:26.812675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:26.812644 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:26.813097 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:26.812763 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:27.811636 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:27.811601 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:27.811818 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:27.811603 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:27.811818 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:27.811763 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:27.811948 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:27.811835 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:28.812595 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:28.812401 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:28.813044 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:28.812693 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:29.811544 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:29.811512 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:29.811544 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:29.811548 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:29.811735 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:29.811632 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:29.811776 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:29.811749 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:30.811947 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:30.811914 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:30.812417 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:30.812017 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:31.811320 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:31.811293 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:31.811511 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:31.811293 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:31.811511 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:31.811427 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:31.811511 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:31.811480 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:32.811897 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:32.811863 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:32.812306 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:32.811994 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:33.465901 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:33.465872 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:33.466102 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.466048 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:33.466102 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.466072 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:33.466102 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.466085 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:33.466228 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.466140 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:37:49.466124005 +0000 UTC m=+33.160159110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:33.566220 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:33.566191 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:33.566427 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:33.566234 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:33.566427 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.566354 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:33.566427 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.566418 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:49.566400918 +0000 UTC m=+33.260436022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:33.566427 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.566354 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:33.566615 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.566461 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:49.566450817 +0000 UTC m=+33.260485921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:33.811376 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:33.811343 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:33.811569 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:33.811344 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:33.811569 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.811483 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:33.811569 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:33.811533 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:34.811982 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:34.811951 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:34.812493 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:34.812085 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:35.811619 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:35.811592 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:35.811797 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:35.811622 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:35.811797 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:35.811706 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:35.811886 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:35.811798 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:36.812881 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:36.812777 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:36.813349 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:36.812969 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:37.811796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:37.811759 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:37.811981 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:37.811892 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:37.811981 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:37.811944 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:37.812101 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:37.812039 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:38.811771 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.811750 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:38.812065 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:38.811834 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:38.926693 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.926664 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" event={"ID":"67cd314639f46c104191661c02cd9b02","Type":"ContainerStarted","Data":"100699b9e73c9e6ba91caa8db8217d9da9e1f106f07f82f3668c377585d2fc97"} Jul 02 11:37:38.931175 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.931147 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"b6ff5e298213fe32762e0b62083dc6d65f9cacc155d0e53c2e6b9bc1462ef2f2"} Jul 02 11:37:38.931286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.931231 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"b010374aa0452d0ea7fb066e569aee18a20c66d6e632b162ace50e55372c0bff"} Jul 02 11:37:38.933879 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.933846 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" event={"ID":"e615272a-f2a4-495f-8737-24c51c0db6d6","Type":"ContainerStarted","Data":"2b5f97a0a702ff1ab8990645f937bb47e9b4fccc3a78dbfe4f13dd639eca1b09"} Jul 02 11:37:38.953675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.952764 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-102.ec2.internal" podStartSLOduration=21.95274326 podStartE2EDuration="21.95274326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:38.949635127 +0000 UTC m=+22.643670253" watchObservedRunningTime="2026-07-02 11:37:38.95274326 +0000 UTC m=+22.646778386" Jul 02 11:37:38.988867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:38.988811 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n5mfc" podStartSLOduration=1.62373112 podStartE2EDuration="21.988791087s" totalImagesPullingTime="20.365059967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:38.98694064 +0000 UTC m=+22.680975766" watchObservedRunningTime="2026-07-02 11:37:38.988791087 +0000 UTC m=+22.682826214" Jul 02 11:37:39.811542 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.811381 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:39.811687 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.811438 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:39.811687 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:39.811609 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:39.811791 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:39.811691 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:39.938154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.938127 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfwwd" event={"ID":"e14d2846-31ec-44d9-946c-07a3c0a394c6","Type":"ContainerStarted","Data":"d8211da515696904a3b8ba84f897f3906ba16e22fe70f3cfeb2f9fe38221104f"} Jul 02 11:37:39.939907 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.939851 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbfnl" event={"ID":"4a830ed0-5015-4c8c-9570-f33c7f61e622","Type":"ContainerStarted","Data":"1ef520ea25fff9cfc8d623f85d9f507410486a7f3b60b4ca4b45e1291a66992c"} Jul 02 11:37:39.941470 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.941440 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="a54452018f6a57b131876bcc19365e295f006f03eb6a724016429452bba30425" exitCode=0 Jul 02 11:37:39.941590 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.941528 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"a54452018f6a57b131876bcc19365e295f006f03eb6a724016429452bba30425"} Jul 02 11:37:39.943293 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.943271 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-99h8m" event={"ID":"d695493a-259d-42cd-adc7-e70cfa7249d8","Type":"ContainerStarted","Data":"685329a230e860de6a641ff9dcefccd77cdc8c41eff881eb00c4f1e25cb1f9cc"} Jul 02 11:37:39.944905 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.944880 2551 generic.go:356] "Generic (PLEG): container finished" podID="543120c32551afd3c62e5d553d438de2" containerID="dffcf15e5b862077e007769a138ed93fa3a44b620d40c173cc19981f8e6cf8ef" exitCode=0 Jul 02 11:37:39.945011 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.944949 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"543120c32551afd3c62e5d553d438de2","Type":"ContainerDied","Data":"dffcf15e5b862077e007769a138ed93fa3a44b620d40c173cc19981f8e6cf8ef"} Jul 02 11:37:39.946824 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.946800 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" event={"ID":"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24","Type":"ContainerStarted","Data":"1765438705da04a7368439fc69370e20c89d3686dd81cca7b06c3187b129f053"} Jul 02 11:37:39.948586 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.948558 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fktrt" event={"ID":"a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf","Type":"ContainerStarted","Data":"16777b3819a877ac2df2132449bbfd96ca1fbcb0df319da511f16aabebcac3a2"} Jul 02 11:37:39.951381 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951365 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:37:39.951755 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951728 2551 generic.go:356] "Generic (PLEG): container finished" podID="cdb8f142-1572-40d8-b293-5b4019ed156f" containerID="b6ff5e298213fe32762e0b62083dc6d65f9cacc155d0e53c2e6b9bc1462ef2f2" exitCode=1 Jul 02 11:37:39.951824 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951786 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerDied","Data":"b6ff5e298213fe32762e0b62083dc6d65f9cacc155d0e53c2e6b9bc1462ef2f2"} Jul 02 11:37:39.951862 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951834 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"0caaa3af579328c11b3c5a8a9c19dfcf37fdcbfd2ebb7ba8a0cb18d8ed3f69c5"} Jul 02 11:37:39.951895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951863 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"80969510c268a2f14774623fdd8267d057f32a6bb38661695f8313badb7bffff"} Jul 02 11:37:39.951895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951891 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"3693064d7a59fefe4621f5e0c84f2a085110e05c240a65122aa7b9f16ed91a47"} Jul 02 11:37:39.951982 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.951926 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"92b62c92086947fbeda4d3363abf8db09985a6cd29eef383010058745870a27c"} Jul 02 11:37:39.953145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.953121 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjt77" event={"ID":"75246532-adc3-4159-9287-424e7ce1f540","Type":"ContainerStarted","Data":"54f591fbc738882e27be16700eba7ad10beb574044a91fade05075271bdf11ea"} Jul 02 11:37:39.958621 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.958586 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dfwwd" podStartSLOduration=2.6704322129999998 podStartE2EDuration="22.958573016s" totalImagesPullingTime="20.288140803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:39.958297121 +0000 UTC m=+23.652332247" watchObservedRunningTime="2026-07-02 11:37:39.958573016 +0000 UTC m=+23.652608141" Jul 02 11:37:39.989282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.989218 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gjt77" podStartSLOduration=2.659045287 podStartE2EDuration="22.989201372s" totalImagesPullingTime="20.330156085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:39.989045517 +0000 UTC m=+23.683080643" watchObservedRunningTime="2026-07-02 11:37:39.989201372 +0000 UTC m=+23.683236492" Jul 02 11:37:39.989460 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:39.989402 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lbfnl" podStartSLOduration=2.613178611 podStartE2EDuration="22.989390778s" totalImagesPullingTime="20.376212167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:39.97380974 +0000 UTC m=+23.667844866" watchObservedRunningTime="2026-07-02 11:37:39.989390778 +0000 UTC m=+23.683425905" Jul 02 11:37:40.006978 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.006905 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fktrt" podStartSLOduration=2.736164262 podStartE2EDuration="23.006888944s" totalImagesPullingTime="20.270724682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:40.006157515 +0000 UTC m=+23.700192641" watchObservedRunningTime="2026-07-02 11:37:40.006888944 +0000 UTC m=+23.700924071" Jul 02 11:37:40.043429 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.043384 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-99h8m" podStartSLOduration=3.237931938 podStartE2EDuration="24.043367305s" totalImagesPullingTime="20.805435367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:40.043276311 +0000 UTC m=+23.737311437" watchObservedRunningTime="2026-07-02 11:37:40.043367305 +0000 UTC m=+23.737402431" Jul 02 11:37:40.682082 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.682053 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 11:37:40.811157 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.811062 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T11:37:40.682073187Z","UUID":"f0a0ede8-2644-4761-9bd9-bdff2151cd11","Handler":null,"Name":"","Endpoint":""} Jul 02 11:37:40.811493 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.811472 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:40.811603 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:40.811579 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:40.812877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.812855 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 11:37:40.813214 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.812897 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 11:37:40.958831 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.958727 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" event={"ID":"543120c32551afd3c62e5d553d438de2","Type":"ContainerStarted","Data":"e35200dd58f21898fac573db0319032dc3f3f86e1164d91034717ceabd81aea3"} Jul 02 11:37:40.960849 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.960779 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" event={"ID":"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24","Type":"ContainerStarted","Data":"b4b1c53830982825a29b32e4908ab4fd2df4c94eb047af5bc988327b115b95fe"} Jul 02 11:37:40.974588 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:40.974546 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-102.ec2.internal" podStartSLOduration=23.974532361 podStartE2EDuration="23.974532361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:40.974334149 +0000 UTC m=+24.668369277" watchObservedRunningTime="2026-07-02 11:37:40.974532361 +0000 UTC m=+24.668567487" Jul 02 11:37:41.812063 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.812033 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:41.812349 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.812078 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:41.812349 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:41.812163 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:41.812349 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:41.812330 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:41.965053 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.965009 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" event={"ID":"e1ded74e-15c3-4a09-afc0-ba6fa0b58d24","Type":"ContainerStarted","Data":"71d1cb19b19a65195e8d131ca1112db05cc4e90b5b5ffd569064d654b66450f9"} Jul 02 11:37:41.968597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.968577 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:37:41.969061 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.969038 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"4448e99be960ae8b02656da2d038cc259aadb69feb4ce67a220c7a64cf592007"} Jul 02 11:37:41.984344 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:41.984293 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqdn2" podStartSLOduration=2.407329307 podStartE2EDuration="24.98427583s" totalImagesPullingTime="22.576946523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:41.984099391 +0000 UTC m=+25.678134517" watchObservedRunningTime="2026-07-02 11:37:41.98427583 +0000 UTC m=+25.678310954" Jul 02 11:37:42.811825 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:42.811775 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:42.812008 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:42.811924 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:43.812213 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.812181 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:43.812680 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.812223 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:43.812680 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:43.812313 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:43.812680 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:43.812472 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:43.879639 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.879606 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:43.880163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.880132 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:43.973305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.973281 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:43.973863 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:43.973846 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dfwwd" Jul 02 11:37:44.811715 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.811518 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:44.811826 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:44.811774 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:44.980198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.980169 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:37:44.980830 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.980560 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"afd7bc58cecf42309255b6f8b6a37a0c6d08657b7bece801995545933b242a34"} Jul 02 11:37:44.980887 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.980833 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:44.980939 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.980905 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:44.981006 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.980993 2551 scope.go:117] "RemoveContainer" containerID="b6ff5e298213fe32762e0b62083dc6d65f9cacc155d0e53c2e6b9bc1462ef2f2" Jul 02 11:37:44.982491 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.982472 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="bbfaf2a25fd9ba10a7337db4f3a4effcb84d1a6aa95f3365bfdbc40f54172077" exitCode=0 Jul 02 11:37:44.982613 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.982557 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"bbfaf2a25fd9ba10a7337db4f3a4effcb84d1a6aa95f3365bfdbc40f54172077"} Jul 02 11:37:44.996156 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:44.996133 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:45.811357 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:45.811330 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:45.811586 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:45.811333 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:45.811586 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:45.811439 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:45.811586 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:45.811532 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:45.988847 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:45.988816 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:37:45.989408 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:45.989160 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" event={"ID":"cdb8f142-1572-40d8-b293-5b4019ed156f","Type":"ContainerStarted","Data":"51d7c84e77c55f0570295fb91a3d597d0e6c4eaec84f22f74ce29c528f192528"} Jul 02 11:37:45.989526 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:45.989503 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:46.004534 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.004508 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:37:46.019540 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.019503 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" podStartSLOduration=8.643690404 podStartE2EDuration="29.019489626s" totalImagesPullingTime="20.375799222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:46.019234767 +0000 UTC m=+29.713269892" watchObservedRunningTime="2026-07-02 11:37:46.019489626 +0000 UTC m=+29.713524751" Jul 02 11:37:46.324310 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.324191 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6l45"] Jul 02 11:37:46.324419 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.324342 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:46.324459 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:46.324425 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:46.327359 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.327336 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glt4f"] Jul 02 11:37:46.327464 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.327432 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:46.327520 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:46.327505 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:46.336976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.336957 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c226k"] Jul 02 11:37:46.337048 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.337033 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:46.337119 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:46.337094 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:46.993373 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.993345 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="e77c4a02682f2250954b834b6d261dac375e1cfa43776e6fdb6e263c41e05341" exitCode=0 Jul 02 11:37:46.993790 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:46.993437 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"e77c4a02682f2250954b834b6d261dac375e1cfa43776e6fdb6e263c41e05341"} Jul 02 11:37:47.811694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:47.811607 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:47.811694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:47.811647 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:47.811943 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:47.811757 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:47.811943 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:47.811910 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:48.812043 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:48.812016 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:48.812407 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:48.812126 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:49.000416 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.000384 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="22b7055597558614b778d80b2ce5624164674f2a936bccfe048e884a5bf57854" exitCode=0 Jul 02 11:37:49.000555 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.000426 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"22b7055597558614b778d80b2ce5624164674f2a936bccfe048e884a5bf57854"} Jul 02 11:37:49.490354 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.490328 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:49.490478 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.490450 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 11:37:49.490478 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.490463 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 11:37:49.490478 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.490471 2551 projected.go:196] Error preparing data for projected volume kube-api-access-79x4w for pod openshift-network-diagnostics/network-check-target-c226k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:49.490585 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.490512 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w podName:45601a67-6788-4f63-908d-f5cd64a2164e nodeName:}" failed. No retries permitted until 2026-07-02 11:38:21.490499402 +0000 UTC m=+65.184534504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-79x4w" (UniqueName: "kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w") pod "network-check-target-c226k" (UID: "45601a67-6788-4f63-908d-f5cd64a2164e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 11:37:49.591147 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.591120 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:49.591241 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.591159 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:49.591290 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.591280 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:49.591339 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.591328 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret podName:e29da5ba-f670-4597-bae8-8be15b820916 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:21.591314986 +0000 UTC m=+65.285350092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret") pod "global-pull-secret-syncer-s6l45" (UID: "e29da5ba-f670-4597-bae8-8be15b820916") : object "kube-system"/"original-pull-secret" not registered Jul 02 11:37:49.591377 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.591280 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:49.591426 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.591416 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs podName:80c775cb-50d6-42d4-a9f5-3382b6d9f094 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:21.591394369 +0000 UTC m=+65.285429472 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs") pod "network-metrics-daemon-glt4f" (UID: "80c775cb-50d6-42d4-a9f5-3382b6d9f094") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 11:37:49.811478 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.811446 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:49.811621 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:49.811490 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:49.811621 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.811608 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6l45" podUID="e29da5ba-f670-4597-bae8-8be15b820916" Jul 02 11:37:49.811781 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:49.811758 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c226k" podUID="45601a67-6788-4f63-908d-f5cd64a2164e" Jul 02 11:37:50.812260 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:50.812229 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:50.812757 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:50.812376 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glt4f" podUID="80c775cb-50d6-42d4-a9f5-3382b6d9f094" Jul 02 11:37:51.605388 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.605311 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-102.ec2.internal" event="NodeReady" Jul 02 11:37:51.605541 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.605449 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 11:37:51.643679 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.643649 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:37:51.645801 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.645763 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.649329 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.649307 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 11:37:51.649450 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.649402 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 11:37:51.649593 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.649570 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 11:37:51.649702 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.649651 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xghqq\"" Jul 02 11:37:51.655160 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.655138 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 11:37:51.671364 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.671340 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:37:51.678508 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.678482 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nfnxc"] Jul 02 11:37:51.680469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.680451 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.683102 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.682987 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 11:37:51.683522 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.683503 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2rdqq\"" Jul 02 11:37:51.683522 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.683513 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 11:37:51.683964 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.683946 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-st69p"] Jul 02 11:37:51.685669 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.685651 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.690243 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.690225 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v4kb4\"" Jul 02 11:37:51.690355 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.690228 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 11:37:51.690648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.690621 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 11:37:51.691024 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.691004 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 11:37:51.695934 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.695903 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nfnxc"] Jul 02 11:37:51.707773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.707749 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st69p"] Jul 02 11:37:51.806228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806197 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.806403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806235 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806270 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afbdf298-77c1-4209-b8bd-89ccf168aac3-cert\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.806403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806300 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bbd704-2cf4-4d3a-98d2-1796f29114a2-tmp-dir\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.806403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmzxx\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806372 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806414 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bbd704-2cf4-4d3a-98d2-1796f29114a2-config-volume\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806455 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8wn\" (UniqueName: \"kubernetes.io/projected/afbdf298-77c1-4209-b8bd-89ccf168aac3-kube-api-access-lc8wn\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806497 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806518 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5ldp\" (UniqueName: \"kubernetes.io/projected/50bbd704-2cf4-4d3a-98d2-1796f29114a2-kube-api-access-b5ldp\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.806880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806673 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.806880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.806699 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.812243 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.812222 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:37:51.812360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.812222 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:37:51.815153 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.815127 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 11:37:51.815486 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.815466 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qk64r\"" Jul 02 11:37:51.815486 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.815484 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 11:37:51.815675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.815484 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 11:37:51.897610 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.897538 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-dgzqf"] Jul 02 11:37:51.899505 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.899486 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:51.907664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907639 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.907769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907682 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.907886 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907864 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.907970 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907905 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.907970 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907934 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afbdf298-77c1-4209-b8bd-89ccf168aac3-cert\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.907970 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907961 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bbd704-2cf4-4d3a-98d2-1796f29114a2-tmp-dir\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.907992 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmzxx\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908009 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908027 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:51.908044 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bbd704-2cf4-4d3a-98d2-1796f29114a2-config-volume\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908075 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8wn\" (UniqueName: \"kubernetes.io/projected/afbdf298-77c1-4209-b8bd-89ccf168aac3-kube-api-access-lc8wn\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.908117 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:51.908089 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.408072241 +0000 UTC m=+36.102107355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:37:51.908469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908125 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908170 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.908469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908195 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5ldp\" (UniqueName: \"kubernetes.io/projected/50bbd704-2cf4-4d3a-98d2-1796f29114a2-kube-api-access-b5ldp\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.908469 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.908277 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50bbd704-2cf4-4d3a-98d2-1796f29114a2-tmp-dir\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.908934 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:51.908915 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:37:51.908999 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:51.908940 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:37:51.909048 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:51.909007 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.40898234 +0000 UTC m=+36.103017458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:37:51.909947 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.909915 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50bbd704-2cf4-4d3a-98d2-1796f29114a2-config-volume\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.913297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.911302 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.913297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.912229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.913297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.912529 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 11:37:51.913297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.912741 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4kxcw\"" Jul 02 11:37:51.913297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.912918 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 11:37:51.913912 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.913887 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 11:37:51.915030 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.914153 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 11:37:51.916155 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.916116 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.917167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.917147 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afbdf298-77c1-4209-b8bd-89ccf168aac3-cert\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.917335 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.917303 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv"] Jul 02 11:37:51.918200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.918159 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.919968 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.919948 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78"] Jul 02 11:37:51.921749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.920885 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:51.921749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.921668 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 11:37:51.921892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.921868 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-dgzqf"] Jul 02 11:37:51.921954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.921945 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:51.923434 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.923416 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 11:37:51.923527 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.923450 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5fw2p\"" Jul 02 11:37:51.924552 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.924536 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 11:37:51.924552 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.924543 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:51.924700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.924538 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:51.925167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.925147 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 11:37:51.925278 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.925190 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:51.925278 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.925206 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:51.925278 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.925264 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 11:37:51.925665 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.925650 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5kknc\"" Jul 02 11:37:51.932495 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.932476 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv"] Jul 02 11:37:51.933916 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.933900 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78"] Jul 02 11:37:51.935830 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.935787 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5ldp\" (UniqueName: \"kubernetes.io/projected/50bbd704-2cf4-4d3a-98d2-1796f29114a2-kube-api-access-b5ldp\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:51.936399 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.936380 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmzxx\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.936531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.936449 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8wn\" (UniqueName: \"kubernetes.io/projected/afbdf298-77c1-4209-b8bd-89ccf168aac3-kube-api-access-lc8wn\") pod \"ingress-canary-st69p\" (UID: \"afbdf298-77c1-4209-b8bd-89ccf168aac3\") " pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:51.936739 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.936722 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:51.965443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.965405 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:51.991841 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.991815 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll"] Jul 02 11:37:51.993877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.993860 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" Jul 02 11:37:51.998722 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:51.998701 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-st69p" Jul 02 11:37:52.001899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.001875 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4pc6q\"" Jul 02 11:37:52.002483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.002464 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79fc79d95c-2vnl5"] Jul 02 11:37:52.003230 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.003210 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:52.004159 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.004143 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj"] Jul 02 11:37:52.004306 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.004286 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.006147 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.006097 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-w84g8"] Jul 02 11:37:52.006228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.006208 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.007796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.007781 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-76kv9"] Jul 02 11:37:52.007918 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.007902 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" Jul 02 11:37:52.009356 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009339 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.009442 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009410 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009499 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009439 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d29bd1-e949-4705-970c-dfc090e2c45a-config\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.009499 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009474 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-service-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009497 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-serving-cert\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009537 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-tmp\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009597 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009565 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpx9v\" (UniqueName: \"kubernetes.io/projected/b8854ed4-6b8f-43b4-8534-a1b04f20a952-kube-api-access-kpx9v\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.009749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009595 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxlx\" (UniqueName: \"kubernetes.io/projected/12d29bd1-e949-4705-970c-dfc090e2c45a-kube-api-access-nsxlx\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.009749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009632 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcglq\" (UniqueName: \"kubernetes.io/projected/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-kube-api-access-wcglq\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009668 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-snapshots\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.009749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009696 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8854ed4-6b8f-43b4-8534-a1b04f20a952-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.009749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009724 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d29bd1-e949-4705-970c-dfc090e2c45a-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.009977 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.009777 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8854ed4-6b8f-43b4-8534-a1b04f20a952-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.015413 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.015395 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:52.019820 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.019799 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 11:37:52.020150 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.020132 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 11:37:52.020259 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.020182 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 11:37:52.020715 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.020700 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 11:37:52.021052 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.021038 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r7tbx\"" Jul 02 11:37:52.024331 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.024314 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:52.024971 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.024955 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 11:37:52.025056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.025010 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 11:37:52.027328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.027308 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m7kmr\"" Jul 02 11:37:52.027418 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.027369 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d77fw\"" Jul 02 11:37:52.027757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.027739 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:52.028691 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.028658 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 11:37:52.031813 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.031794 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 11:37:52.034276 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.034240 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 11:37:52.038675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.038601 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll"] Jul 02 11:37:52.038933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.038914 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 11:37:52.039315 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.039295 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 11:37:52.039449 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.039432 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 11:37:52.039550 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.039527 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nl6gd\"" Jul 02 11:37:52.045033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.045013 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj"] Jul 02 11:37:52.045500 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.045479 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 11:37:52.045987 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.045966 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-w84g8"] Jul 02 11:37:52.060556 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.060539 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-76kv9"] Jul 02 11:37:52.062061 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.062015 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79fc79d95c-2vnl5"] Jul 02 11:37:52.111135 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111108 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.111236 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111155 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqfx4\" (UniqueName: \"kubernetes.io/projected/b11e0478-863b-42a6-ba31-25780b9a6a15-kube-api-access-wqfx4\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.111236 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111188 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-stats-auth\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.111236 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111228 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-service-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.111589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111332 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-serving-cert\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.111589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111389 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxlx\" (UniqueName: \"kubernetes.io/projected/12d29bd1-e949-4705-970c-dfc090e2c45a-kube-api-access-nsxlx\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.111589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b11e0478-863b-42a6-ba31-25780b9a6a15-serving-cert\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.111589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111540 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-tmp\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.111791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5c5p\" (UniqueName: \"kubernetes.io/projected/62f7160a-badd-4f23-b2a9-a0d88d6558ad-kube-api-access-j5c5p\") pod \"volume-data-source-validator-69d9f679db-kxvll\" (UID: \"62f7160a-badd-4f23-b2a9-a0d88d6558ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" Jul 02 11:37:52.111791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111709 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8854ed4-6b8f-43b4-8534-a1b04f20a952-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.111791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111750 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-trusted-ca\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111803 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111834 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f8251277-aebb-44c6-b196-a028cdbf71c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111842 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-service-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111864 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8854ed4-6b8f-43b4-8534-a1b04f20a952-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111888 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.111938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111899 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-tmp\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111961 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d29bd1-e949-4705-970c-dfc090e2c45a-config\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.111990 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5tm\" (UniqueName: \"kubernetes.io/projected/860ac98e-388c-47ce-a650-3517cab5b724-kube-api-access-5w5tm\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112022 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112037 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpx9v\" (UniqueName: \"kubernetes.io/projected/b8854ed4-6b8f-43b4-8534-a1b04f20a952-kube-api-access-kpx9v\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112073 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcglq\" (UniqueName: \"kubernetes.io/projected/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-kube-api-access-wcglq\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112104 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-snapshots\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112130 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnhk\" (UniqueName: \"kubernetes.io/projected/f8251277-aebb-44c6-b196-a028cdbf71c7-kube-api-access-gtnhk\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112158 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112187 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d29bd1-e949-4705-970c-dfc090e2c45a-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.112216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112210 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-config\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.112719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112241 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbtsq\" (UniqueName: \"kubernetes.io/projected/85d9c70f-3a50-4d80-9985-d2d792b52e7d-kube-api-access-qbtsq\") pod \"network-check-source-56499946bc-w84g8\" (UID: \"85d9c70f-3a50-4d80-9985-d2d792b52e7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" Jul 02 11:37:52.112719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112326 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-default-certificate\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.112719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112374 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8854ed4-6b8f-43b4-8534-a1b04f20a952-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.112719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112459 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12d29bd1-e949-4705-970c-dfc090e2c45a-config\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.112945 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.112876 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-snapshots\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.114239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.114210 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-serving-cert\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.114672 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.114645 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12d29bd1-e949-4705-970c-dfc090e2c45a-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.115056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.115039 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8854ed4-6b8f-43b4-8534-a1b04f20a952-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.121737 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.121561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:52.131350 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.131332 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpx9v\" (UniqueName: \"kubernetes.io/projected/b8854ed4-6b8f-43b4-8534-a1b04f20a952-kube-api-access-kpx9v\") pod \"kube-storage-version-migrator-operator-79964ff6f9-flkdv\" (UID: \"b8854ed4-6b8f-43b4-8534-a1b04f20a952\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.133859 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.133834 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxlx\" (UniqueName: \"kubernetes.io/projected/12d29bd1-e949-4705-970c-dfc090e2c45a-kube-api-access-nsxlx\") pod \"service-ca-operator-5d7b7dc95c-b2z78\" (UID: \"12d29bd1-e949-4705-970c-dfc090e2c45a\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.134219 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.134199 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcglq\" (UniqueName: \"kubernetes.io/projected/c9249aee-3e1f-4e45-81ed-a6bb8f6a158c-kube-api-access-wcglq\") pod \"insights-operator-5f67b55555-dgzqf\" (UID: \"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c\") " pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.198973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.198906 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd"] Jul 02 11:37:52.202127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.202103 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.207178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.207146 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 11:37:52.207178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.207172 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:37:52.207374 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.207187 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 11:37:52.207515 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.207500 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jdkrv\"" Jul 02 11:37:52.208548 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.208517 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" Jul 02 11:37:52.213111 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213090 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnhk\" (UniqueName: \"kubernetes.io/projected/f8251277-aebb-44c6-b196-a028cdbf71c7-kube-api-access-gtnhk\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.213203 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213127 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.213203 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213155 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-config\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.213203 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213181 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbtsq\" (UniqueName: \"kubernetes.io/projected/85d9c70f-3a50-4d80-9985-d2d792b52e7d-kube-api-access-qbtsq\") pod \"network-check-source-56499946bc-w84g8\" (UID: \"85d9c70f-3a50-4d80-9985-d2d792b52e7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" Jul 02 11:37:52.213348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213219 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-default-certificate\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.213348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213271 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqfx4\" (UniqueName: \"kubernetes.io/projected/b11e0478-863b-42a6-ba31-25780b9a6a15-kube-api-access-wqfx4\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.213348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213302 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-stats-auth\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.213348 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.213322 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.713302524 +0000 UTC m=+36.407337641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:37:52.213537 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.213374 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b11e0478-863b-42a6-ba31-25780b9a6a15-serving-cert\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.215351 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215156 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5c5p\" (UniqueName: \"kubernetes.io/projected/62f7160a-badd-4f23-b2a9-a0d88d6558ad-kube-api-access-j5c5p\") pod \"volume-data-source-validator-69d9f679db-kxvll\" (UID: \"62f7160a-badd-4f23-b2a9-a0d88d6558ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" Jul 02 11:37:52.215351 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215218 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-trusted-ca\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.215351 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215287 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.215765 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215696 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f8251277-aebb-44c6-b196-a028cdbf71c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.215765 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215743 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.215870 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.215805 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5tm\" (UniqueName: \"kubernetes.io/projected/860ac98e-388c-47ce-a650-3517cab5b724-kube-api-access-5w5tm\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.216157 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216136 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b11e0478-863b-42a6-ba31-25780b9a6a15-serving-cert\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.216238 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.216138 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:52.216238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216162 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-stats-auth\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.216238 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.216227 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.716206386 +0000 UTC m=+36.410241492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:52.216425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216271 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-trusted-ca\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.216425 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.216301 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:37:52.216425 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.216355 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.716337974 +0000 UTC m=+36.410373089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:37:52.216425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216389 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-default-certificate\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.216649 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216631 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b11e0478-863b-42a6-ba31-25780b9a6a15-config\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.216851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216829 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f8251277-aebb-44c6-b196-a028cdbf71c7-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.216937 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.216923 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd"] Jul 02 11:37:52.226187 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.226165 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnhk\" (UniqueName: \"kubernetes.io/projected/f8251277-aebb-44c6-b196-a028cdbf71c7-kube-api-access-gtnhk\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.230805 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.230784 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5c5p\" (UniqueName: \"kubernetes.io/projected/62f7160a-badd-4f23-b2a9-a0d88d6558ad-kube-api-access-j5c5p\") pod \"volume-data-source-validator-69d9f679db-kxvll\" (UID: \"62f7160a-badd-4f23-b2a9-a0d88d6558ad\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" Jul 02 11:37:52.231044 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.231020 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5tm\" (UniqueName: \"kubernetes.io/projected/860ac98e-388c-47ce-a650-3517cab5b724-kube-api-access-5w5tm\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.234330 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.234309 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" Jul 02 11:37:52.234422 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.234390 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbtsq\" (UniqueName: \"kubernetes.io/projected/85d9c70f-3a50-4d80-9985-d2d792b52e7d-kube-api-access-qbtsq\") pod \"network-check-source-56499946bc-w84g8\" (UID: \"85d9c70f-3a50-4d80-9985-d2d792b52e7d\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" Jul 02 11:37:52.236458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.236440 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqfx4\" (UniqueName: \"kubernetes.io/projected/b11e0478-863b-42a6-ba31-25780b9a6a15-kube-api-access-wqfx4\") pod \"console-operator-7fdbdf9c99-76kv9\" (UID: \"b11e0478-863b-42a6-ba31-25780b9a6a15\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.249133 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.249115 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" Jul 02 11:37:52.275648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.275612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:52.303969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.303947 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" Jul 02 11:37:52.317056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.317030 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.317222 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.317202 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b4s\" (UniqueName: \"kubernetes.io/projected/8ed44b23-16e3-4c61-80ae-dde4eecb7897-kube-api-access-s5b4s\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.329158 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.329130 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" Jul 02 11:37:52.335794 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.335772 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:37:52.376165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.376130 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:52.418151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.418124 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b4s\" (UniqueName: \"kubernetes.io/projected/8ed44b23-16e3-4c61-80ae-dde4eecb7897-kube-api-access-s5b4s\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.418277 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.418172 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:52.418277 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.418201 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.418375 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.418288 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:52.418375 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418306 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:37:52.418375 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418323 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:37:52.418375 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418355 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:37:52.418566 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418382 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.418368372 +0000 UTC m=+37.112403479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:37:52.418566 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418386 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:37:52.418566 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418408 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:52.918395274 +0000 UTC m=+36.612430376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:37:52.418566 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.418443 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.418428251 +0000 UTC m=+37.112463360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:37:52.427754 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.427729 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b4s\" (UniqueName: \"kubernetes.io/projected/8ed44b23-16e3-4c61-80ae-dde4eecb7897-kube-api-access-s5b4s\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.720772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.720728 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.720966 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.720839 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:52.720966 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.720878 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:37:52.720966 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.720954 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.720932816 +0000 UTC m=+37.414967920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:37:52.721140 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.720989 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.720976966 +0000 UTC m=+37.415012072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:37:52.721140 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.721020 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:52.721140 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.721101 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:52.721140 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.721136 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.721126376 +0000 UTC m=+37.415161489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:52.812366 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.812340 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:37:52.815918 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.815895 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 11:37:52.816202 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.816182 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slsdl\"" Jul 02 11:37:52.922535 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:52.922505 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:52.922685 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.922642 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:37:52.922755 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:52.922707 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:53.922689009 +0000 UTC m=+37.616724122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:37:53.314027 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.313062 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-dgzqf"] Jul 02 11:37:53.320208 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.320170 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9249aee_3e1f_4e45_81ed_a6bb8f6a158c.slice/crio-a901869ceea261453c25cc6dd442ccfff6a42f6dff95ee470d61b516bc9aa584 WatchSource:0}: Error finding container a901869ceea261453c25cc6dd442ccfff6a42f6dff95ee470d61b516bc9aa584: Status 404 returned error can't find the container with id a901869ceea261453c25cc6dd442ccfff6a42f6dff95ee470d61b516bc9aa584 Jul 02 11:37:53.331785 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.331675 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-w84g8"] Jul 02 11:37:53.335128 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.334884 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-76kv9"] Jul 02 11:37:53.336958 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.336923 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d9c70f_3a50_4d80_9985_d2d792b52e7d.slice/crio-7c41e89d7e8204befb8ca0c2ec71f281ad04ac8b1f95a6d98fbedad88ea0b593 WatchSource:0}: Error finding container 7c41e89d7e8204befb8ca0c2ec71f281ad04ac8b1f95a6d98fbedad88ea0b593: Status 404 returned error can't find the container with id 7c41e89d7e8204befb8ca0c2ec71f281ad04ac8b1f95a6d98fbedad88ea0b593 Jul 02 11:37:53.340656 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.340621 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11e0478_863b_42a6_ba31_25780b9a6a15.slice/crio-d76f0d822df2bfbea0151532e38c2a8911ad26ca9b778d71fcc3989c6ad1e5e8 WatchSource:0}: Error finding container d76f0d822df2bfbea0151532e38c2a8911ad26ca9b778d71fcc3989c6ad1e5e8: Status 404 returned error can't find the container with id d76f0d822df2bfbea0151532e38c2a8911ad26ca9b778d71fcc3989c6ad1e5e8 Jul 02 11:37:53.343472 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.343329 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll"] Jul 02 11:37:53.346926 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.346886 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f7160a_badd_4f23_b2a9_a0d88d6558ad.slice/crio-2af28a5b668232151de5d6399c38ee1100c9229373b32a4f8483c87c6a9860a2 WatchSource:0}: Error finding container 2af28a5b668232151de5d6399c38ee1100c9229373b32a4f8483c87c6a9860a2: Status 404 returned error can't find the container with id 2af28a5b668232151de5d6399c38ee1100c9229373b32a4f8483c87c6a9860a2 Jul 02 11:37:53.348342 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.348166 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78"] Jul 02 11:37:53.350877 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.350849 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d29bd1_e949_4705_970c_dfc090e2c45a.slice/crio-e9a444fdf7be49c716326c8248c850874a58f918111db2513e9fe1bf1858cf9b WatchSource:0}: Error finding container e9a444fdf7be49c716326c8248c850874a58f918111db2513e9fe1bf1858cf9b: Status 404 returned error can't find the container with id e9a444fdf7be49c716326c8248c850874a58f918111db2513e9fe1bf1858cf9b Jul 02 11:37:53.351165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.351148 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv"] Jul 02 11:37:53.352758 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.352738 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-st69p"] Jul 02 11:37:53.355986 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.355961 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8854ed4_6b8f_43b4_8534_a1b04f20a952.slice/crio-d7fd817bd522b74d8a08aabbb61a0df5b75287be79f5a3792154387b20f6bb7b WatchSource:0}: Error finding container d7fd817bd522b74d8a08aabbb61a0df5b75287be79f5a3792154387b20f6bb7b: Status 404 returned error can't find the container with id d7fd817bd522b74d8a08aabbb61a0df5b75287be79f5a3792154387b20f6bb7b Jul 02 11:37:53.356581 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:37:53.356555 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbdf298_77c1_4209_b8bd_89ccf168aac3.slice/crio-e01a03c4ff0cbdfe89f0901ddec5950deaff27b11536557792b26d2d50c9088c WatchSource:0}: Error finding container e01a03c4ff0cbdfe89f0901ddec5950deaff27b11536557792b26d2d50c9088c: Status 404 returned error can't find the container with id e01a03c4ff0cbdfe89f0901ddec5950deaff27b11536557792b26d2d50c9088c Jul 02 11:37:53.428433 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.428409 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:53.428567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.428553 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:53.428639 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.428570 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:37:53.428639 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.428602 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:37:53.428733 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.428665 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:37:53.428733 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.428673 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.428652368 +0000 UTC m=+39.122687491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:37:53.428733 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.428721 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.42870614 +0000 UTC m=+39.122741243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:37:53.731039 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.730929 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:53.731039 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.730975 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.731051 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.731079 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.731143 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.731129184 +0000 UTC m=+39.425164290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.731159 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.731171 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.731155943 +0000 UTC m=+39.425191065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:37:53.731262 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.731208 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.731194017 +0000 UTC m=+39.425229123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:37:53.933343 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:53.933305 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:53.934173 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.933440 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:37:53.934173 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:53.933498 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:55.933481176 +0000 UTC m=+39.627516284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:37:54.015143 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.015029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" event={"ID":"62f7160a-badd-4f23-b2a9-a0d88d6558ad","Type":"ContainerStarted","Data":"2af28a5b668232151de5d6399c38ee1100c9229373b32a4f8483c87c6a9860a2"} Jul 02 11:37:54.016612 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.016582 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" event={"ID":"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c","Type":"ContainerStarted","Data":"a901869ceea261453c25cc6dd442ccfff6a42f6dff95ee470d61b516bc9aa584"} Jul 02 11:37:54.018644 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.018606 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" event={"ID":"85d9c70f-3a50-4d80-9985-d2d792b52e7d","Type":"ContainerStarted","Data":"7c41e89d7e8204befb8ca0c2ec71f281ad04ac8b1f95a6d98fbedad88ea0b593"} Jul 02 11:37:54.020083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.020055 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" event={"ID":"b11e0478-863b-42a6-ba31-25780b9a6a15","Type":"ContainerStarted","Data":"d76f0d822df2bfbea0151532e38c2a8911ad26ca9b778d71fcc3989c6ad1e5e8"} Jul 02 11:37:54.024420 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.024237 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="3214819e1464b5888445826f340bcd36a4385c53dcc097a4f5fa5002dad43c1c" exitCode=0 Jul 02 11:37:54.024420 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.024334 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"3214819e1464b5888445826f340bcd36a4385c53dcc097a4f5fa5002dad43c1c"} Jul 02 11:37:54.026112 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.026087 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st69p" event={"ID":"afbdf298-77c1-4209-b8bd-89ccf168aac3","Type":"ContainerStarted","Data":"e01a03c4ff0cbdfe89f0901ddec5950deaff27b11536557792b26d2d50c9088c"} Jul 02 11:37:54.027807 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.027751 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" event={"ID":"b8854ed4-6b8f-43b4-8534-a1b04f20a952","Type":"ContainerStarted","Data":"d7fd817bd522b74d8a08aabbb61a0df5b75287be79f5a3792154387b20f6bb7b"} Jul 02 11:37:54.029046 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:54.029023 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" event={"ID":"12d29bd1-e949-4705-970c-dfc090e2c45a","Type":"ContainerStarted","Data":"e9a444fdf7be49c716326c8248c850874a58f918111db2513e9fe1bf1858cf9b"} Jul 02 11:37:55.040358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.040323 2551 generic.go:356] "Generic (PLEG): container finished" podID="39ffdf1b-e9ed-46e8-904c-6a374390f553" containerID="dfac13e0f39c019db00c4de18cd01548124deee15e35bea7358929d6da54fee4" exitCode=0 Jul 02 11:37:55.040818 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.040405 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerDied","Data":"dfac13e0f39c019db00c4de18cd01548124deee15e35bea7358929d6da54fee4"} Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.451208 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.451338 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.451511 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.451579 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.451557521 +0000 UTC m=+43.145592626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.452014 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.452033 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:37:55.452167 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.452082 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.452065578 +0000 UTC m=+43.146100682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:37:55.754151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.754116 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:55.754309 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.754283 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:55.754434 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.754326 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:55.754521 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.754500 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:37:55.754576 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.754564 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.754544519 +0000 UTC m=+43.448579636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:37:55.754654 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.754643 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.754631578 +0000 UTC m=+43.448666681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:37:55.754762 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.754740 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:55.754838 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.754810 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.75479164 +0000 UTC m=+43.448826769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:55.957057 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:55.956948 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:55.957217 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.957075 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:37:55.957217 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:55.957147 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:37:59.957128146 +0000 UTC m=+43.651163253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:37:56.051024 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.050039 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46qn8" event={"ID":"39ffdf1b-e9ed-46e8-904c-6a374390f553","Type":"ContainerStarted","Data":"3b7a31ae8a8913ac6a17e496a1e827fff086f8e456d61436b66de29bc111a881"} Jul 02 11:37:56.077809 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.077759 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-46qn8" podStartSLOduration=8.848757569 podStartE2EDuration="40.077738031s" totalImagesPullingTime="31.228980462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:37:56.076599875 +0000 UTC m=+39.770635004" watchObservedRunningTime="2026-07-02 11:37:56.077738031 +0000 UTC m=+39.771773157" Jul 02 11:37:56.202975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.202895 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:56.304678 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.304604 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:56.472825 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.472788 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:56.563566 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:56.563504 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:59.140769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.140721 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:59.243539 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.243488 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:59.485467 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.485397 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:37:59.485592 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.485471 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:37:59.485592 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.485545 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:37:59.485592 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.485560 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:37:59.485592 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.485563 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:37:59.485717 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.485611 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.485598365 +0000 UTC m=+51.179633468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:37:59.485717 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.485624 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.485617656 +0000 UTC m=+51.179652759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:37:59.704039 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.703993 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:59.788616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.788583 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:37:59.788776 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.788630 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:59.788776 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.788685 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:37:59.788776 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.788757 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:59.788930 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.788805 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:37:59.788930 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.788821 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.788807923 +0000 UTC m=+51.482843026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:37:59.788930 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.788837 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.788830939 +0000 UTC m=+51.482866042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:37:59.788930 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.788866 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.788849097 +0000 UTC m=+51.482884202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:37:59.804181 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.804153 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:37:59.990874 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:37:59.990837 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:37:59.991050 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.990969 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:37:59.991117 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:37:59.991051 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:07.991030426 +0000 UTC m=+51.685065543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:38:01.563700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:01.563655 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:01.661102 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:01.661069 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:01.764565 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:01.764529 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:02.071606 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.071572 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" event={"ID":"85d9c70f-3a50-4d80-9985-d2d792b52e7d","Type":"ContainerStarted","Data":"8cb4f82c06a92683135fa6a56a1029a918d4774881abeba36ee9e14e840918d9"} Jul 02 11:38:02.073593 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.073569 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/0.log" Jul 02 11:38:02.073717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.073608 2551 generic.go:356] "Generic (PLEG): container finished" podID="b11e0478-863b-42a6-ba31-25780b9a6a15" containerID="7e53bb3aaba415cd860bc0002df1fab684428939b19c40d033b79465efcbe2a8" exitCode=255 Jul 02 11:38:02.073717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.073684 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" event={"ID":"b11e0478-863b-42a6-ba31-25780b9a6a15","Type":"ContainerDied","Data":"7e53bb3aaba415cd860bc0002df1fab684428939b19c40d033b79465efcbe2a8"} Jul 02 11:38:02.074040 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.073934 2551 scope.go:117] "RemoveContainer" containerID="7e53bb3aaba415cd860bc0002df1fab684428939b19c40d033b79465efcbe2a8" Jul 02 11:38:02.076010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.075954 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-st69p" event={"ID":"afbdf298-77c1-4209-b8bd-89ccf168aac3","Type":"ContainerStarted","Data":"72691f77b2c890a14a4e1ccede585acaa6c92f8ee0e6c48aa3323f7d6618e5fb"} Jul 02 11:38:02.077723 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.077702 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" event={"ID":"b8854ed4-6b8f-43b4-8534-a1b04f20a952","Type":"ContainerStarted","Data":"2939fcfe7c5c1a04f57d1e8c6a3d83060fba489012a5b462f26cc8cd735b6be1"} Jul 02 11:38:02.079321 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.079299 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" event={"ID":"12d29bd1-e949-4705-970c-dfc090e2c45a","Type":"ContainerStarted","Data":"095b1392e423dfd1d7c5bcfcb9bffc052ca446f65c269438419c70e2748abdc6"} Jul 02 11:38:02.080891 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.080866 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" event={"ID":"62f7160a-badd-4f23-b2a9-a0d88d6558ad","Type":"ContainerStarted","Data":"eb84f4b2f2fee6eba580bc7bc41d3956f2dc9a885968751609dc493462e566c1"} Jul 02 11:38:02.082525 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.082504 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" event={"ID":"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c","Type":"ContainerStarted","Data":"ae3a9896f555795bb9ff3bfe2d7221a47ab9d6bc6af17d602a0b9133ddfb3f26"} Jul 02 11:38:02.134880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.134824 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-w84g8" podStartSLOduration=3.364748542 podStartE2EDuration="11.134805467s" totalImagesPullingTime="7.770056925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.104231476 +0000 UTC m=+45.798266600" watchObservedRunningTime="2026-07-02 11:38:02.134805467 +0000 UTC m=+45.828840591" Jul 02 11:38:02.160858 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.160808 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" podStartSLOduration=3.382924796 podStartE2EDuration="11.160789124s" totalImagesPullingTime="7.777864328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.159991521 +0000 UTC m=+45.854026648" watchObservedRunningTime="2026-07-02 11:38:02.160789124 +0000 UTC m=+45.854824250" Jul 02 11:38:02.212404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.212349 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" podStartSLOduration=3.468108697 podStartE2EDuration="11.212328132s" totalImagesPullingTime="7.744219435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.187061052 +0000 UTC m=+45.881096178" watchObservedRunningTime="2026-07-02 11:38:02.212328132 +0000 UTC m=+45.906363238" Jul 02 11:38:02.239058 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.239009 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-st69p" podStartSLOduration=3.495550041 podStartE2EDuration="11.238989183s" totalImagesPullingTime="7.743439142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.238718633 +0000 UTC m=+45.932753760" watchObservedRunningTime="2026-07-02 11:38:02.238989183 +0000 UTC m=+45.933024321" Jul 02 11:38:02.240265 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.240215 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-kxvll" podStartSLOduration=3.573091879 podStartE2EDuration="11.240198472s" totalImagesPullingTime="7.667106593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.212675365 +0000 UTC m=+45.906710491" watchObservedRunningTime="2026-07-02 11:38:02.240198472 +0000 UTC m=+45.934233602" Jul 02 11:38:02.264193 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.264147 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" podStartSLOduration=3.51702287 podStartE2EDuration="11.264130799s" totalImagesPullingTime="7.747107929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:02.263155246 +0000 UTC m=+45.957190372" watchObservedRunningTime="2026-07-02 11:38:02.264130799 +0000 UTC m=+45.958165924" Jul 02 11:38:02.335961 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.335903 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:02.336091 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.335987 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:02.336641 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.336607 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:02.582056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.582023 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:02.841537 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.841502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:02.957244 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:02.957207 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:03.088239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.088207 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:38:03.088783 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.088751 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/0.log" Jul 02 11:38:03.088906 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.088790 2551 generic.go:356] "Generic (PLEG): container finished" podID="b11e0478-863b-42a6-ba31-25780b9a6a15" containerID="ab71555463fb63a863015e55fe8839155c9e6e6272d74a1728a7be07c23711fd" exitCode=255 Jul 02 11:38:03.088980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.088928 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" event={"ID":"b11e0478-863b-42a6-ba31-25780b9a6a15","Type":"ContainerDied","Data":"ab71555463fb63a863015e55fe8839155c9e6e6272d74a1728a7be07c23711fd"} Jul 02 11:38:03.089037 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.089014 2551 scope.go:117] "RemoveContainer" containerID="7e53bb3aaba415cd860bc0002df1fab684428939b19c40d033b79465efcbe2a8" Jul 02 11:38:03.089483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.089416 2551 scope.go:117] "RemoveContainer" containerID="ab71555463fb63a863015e55fe8839155c9e6e6272d74a1728a7be07c23711fd" Jul 02 11:38:03.089611 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.089574 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-76kv9_openshift-console-operator(b11e0478-863b-42a6-ba31-25780b9a6a15)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" podUID="b11e0478-863b-42a6-ba31-25780b9a6a15" Jul 02 11:38:03.147345 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.147220 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-skw6v"] Jul 02 11:38:03.178073 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.178041 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skw6v"] Jul 02 11:38:03.178205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.178153 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.181025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.181003 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 11:38:03.181157 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.181044 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 11:38:03.182546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.182527 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkpff\"" Jul 02 11:38:03.217648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.217623 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.217790 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.217674 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6589c8-d42f-43a0-b32c-76191c220627-data-volume\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.217790 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.217705 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b6589c8-d42f-43a0-b32c-76191c220627-crio-socket\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.217886 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.217786 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.217886 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.217870 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bg4m\" (UniqueName: \"kubernetes.io/projected/9b6589c8-d42f-43a0-b32c-76191c220627-kube-api-access-6bg4m\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.260529 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.260493 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:03.318698 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318665 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bg4m\" (UniqueName: \"kubernetes.io/projected/9b6589c8-d42f-43a0-b32c-76191c220627-kube-api-access-6bg4m\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.318862 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318744 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.318862 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318781 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6589c8-d42f-43a0-b32c-76191c220627-data-volume\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.318862 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318814 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b6589c8-d42f-43a0-b32c-76191c220627-crio-socket\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.318992 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.318884 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 11:38:03.318992 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.318945 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:03.81893018 +0000 UTC m=+47.512965282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : secret "insights-runtime-extractor-tls" not found Jul 02 11:38:03.318992 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318970 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b6589c8-d42f-43a0-b32c-76191c220627-crio-socket\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.318992 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.318979 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.319188 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.319022 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 11:38:03.319188 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.319051 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:03.819043302 +0000 UTC m=+47.513078405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : configmap "kube-rbac-proxy" not found Jul 02 11:38:03.319188 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.319127 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b6589c8-d42f-43a0-b32c-76191c220627-data-volume\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.332002 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.331972 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bg4m\" (UniqueName: \"kubernetes.io/projected/9b6589c8-d42f-43a0-b32c-76191c220627-kube-api-access-6bg4m\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.356998 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.356969 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:03.821998 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.821967 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.822413 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:03.822052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:03.822413 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.822112 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 11:38:03.822413 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.822176 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:04.822162238 +0000 UTC m=+48.516197344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : secret "insights-runtime-extractor-tls" not found Jul 02 11:38:03.822413 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.822183 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 11:38:03.822413 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:03.822241 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:04.822224468 +0000 UTC m=+48.516259592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : configmap "kube-rbac-proxy" not found Jul 02 11:38:04.001797 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.001769 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:04.093085 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.093013 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:38:04.093411 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.093394 2551 scope.go:117] "RemoveContainer" containerID="ab71555463fb63a863015e55fe8839155c9e6e6272d74a1728a7be07c23711fd" Jul 02 11:38:04.093613 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:04.093583 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-76kv9_openshift-console-operator(b11e0478-863b-42a6-ba31-25780b9a6a15)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" podUID="b11e0478-863b-42a6-ba31-25780b9a6a15" Jul 02 11:38:04.093728 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.093696 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:04.369533 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.369440 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:04.441197 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.441158 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:04.830063 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.830030 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:04.830459 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:04.830139 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 11:38:04.830459 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:04.830194 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:06.830178904 +0000 UTC m=+50.524214007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : configmap "kube-rbac-proxy" not found Jul 02 11:38:04.830459 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.830138 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:04.830459 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:04.830217 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 11:38:04.830459 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:04.830284 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:06.830271019 +0000 UTC m=+50.524306123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : secret "insights-runtime-extractor-tls" not found Jul 02 11:38:04.853812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.853790 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjt77_75246532-adc3-4159-9287-424e7ce1f540/dns-node-resolver/0.log" Jul 02 11:38:04.885235 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.885203 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:04.944746 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:04.944717 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:05.421137 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:05.421101 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:05.847058 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:05.847034 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fktrt_a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf/node-ca/0.log" Jul 02 11:38:05.858237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:05.858209 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:06.648345 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:06.648316 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-st69p_afbdf298-77c1-4209-b8bd-89ccf168aac3/serve-healthcheck-canary/0.log" Jul 02 11:38:06.844834 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:06.844807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:06.844986 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:06.844880 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:06.844986 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:06.844948 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 11:38:06.844986 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:06.844983 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 11:38:06.845109 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:06.845013 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:10.844995683 +0000 UTC m=+54.539030785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : secret "insights-runtime-extractor-tls" not found Jul 02 11:38:06.845109 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:06.845030 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:10.845023696 +0000 UTC m=+54.539058799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : configmap "kube-rbac-proxy" not found Jul 02 11:38:07.550596 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.550560 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.550668 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.550710 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.550733 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d79bd58d-6nmk9: secret "image-registry-tls" not found Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.550783 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls podName:fc279d36-fa65-4a45-af0c-dacc74018a3b nodeName:}" failed. No retries permitted until 2026-07-02 11:38:23.550769792 +0000 UTC m=+67.244804895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls") pod "image-registry-58d79bd58d-6nmk9" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b") : secret "image-registry-tls" not found Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.550800 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 11:38:07.551005 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.550845 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls podName:50bbd704-2cf4-4d3a-98d2-1796f29114a2 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:23.550832423 +0000 UTC m=+67.244867531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls") pod "dns-default-nfnxc" (UID: "50bbd704-2cf4-4d3a-98d2-1796f29114a2") : secret "dns-default-metrics-tls" not found Jul 02 11:38:07.641258 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.641224 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:07.853096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.853014 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:38:07.853096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.853060 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:07.853302 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.853151 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 11:38:07.853302 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.853156 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 11:38:07.853302 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.853218 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:23.853199031 +0000 UTC m=+67.547234134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : secret "router-metrics-certs-default" not found Jul 02 11:38:07.853302 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.853237 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls podName:f8251277-aebb-44c6-b196-a028cdbf71c7 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:23.853230629 +0000 UTC m=+67.547265732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-r9cpj" (UID: "f8251277-aebb-44c6-b196-a028cdbf71c7") : secret "cluster-monitoring-operator-tls" not found Jul 02 11:38:07.853302 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:07.853286 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:07.853466 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:07.853373 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle podName:860ac98e-388c-47ce-a650-3517cab5b724 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:23.853364774 +0000 UTC m=+67.547399877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle") pod "router-default-79fc79d95c-2vnl5" (UID: "860ac98e-388c-47ce-a650-3517cab5b724") : configmap references non-existent config key: service-ca.crt Jul 02 11:38:08.054508 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:08.054480 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:38:08.054655 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:08.054614 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 11:38:08.054697 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:08.054669 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls podName:8ed44b23-16e3-4c61-80ae-dde4eecb7897 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:24.054654472 +0000 UTC m=+67.748689575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-6t7kd" (UID: "8ed44b23-16e3-4c61-80ae-dde4eecb7897") : secret "samples-operator-tls" not found Jul 02 11:38:09.068262 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.068220 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.433666 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.433593 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.565417 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.565385 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.666937 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.666910 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.769981 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.769925 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.887715 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.887687 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:09.985677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:09.985642 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:10.134715 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:10.134687 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:10.877006 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:10.876973 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:10.877244 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:10.877115 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:10.877244 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:10.877118 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 11:38:10.877244 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:10.877211 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls podName:9b6589c8-d42f-43a0-b32c-76191c220627 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:18.877198137 +0000 UTC m=+62.571233240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skw6v" (UID: "9b6589c8-d42f-43a0-b32c-76191c220627") : secret "insights-runtime-extractor-tls" not found Jul 02 11:38:10.877618 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:10.877600 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b6589c8-d42f-43a0-b32c-76191c220627-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:10.917481 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:10.917444 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:11.562114 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:11.562082 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:11.711210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:11.711185 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:12.119757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.119724 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:12.264456 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.264426 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:12.336365 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.336336 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:12.336498 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.336392 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:12.336750 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.336736 2551 scope.go:117] "RemoveContainer" containerID="ab71555463fb63a863015e55fe8839155c9e6e6272d74a1728a7be07c23711fd" Jul 02 11:38:12.364777 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.364752 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:12.946042 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:12.946006 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.064011 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.063975 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.123135 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.123114 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:38:13.123284 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.123176 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" event={"ID":"b11e0478-863b-42a6-ba31-25780b9a6a15","Type":"ContainerStarted","Data":"09d22692c147e7bbe5f9ab74f30cd88ab3314258de7acd93a3ebef6cec16ba63"} Jul 02 11:38:13.123483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.123464 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:13.127894 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.127877 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" Jul 02 11:38:13.144025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.143983 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-76kv9" podStartSLOduration=14.384774402 podStartE2EDuration="22.143971015s" totalImagesPullingTime="7.759196613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:13.143287573 +0000 UTC m=+56.837322694" watchObservedRunningTime="2026-07-02 11:38:13.143971015 +0000 UTC m=+56.838006177" Jul 02 11:38:13.148308 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.148282 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.242722 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.242655 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.344215 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.344188 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.427640 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.427606 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.515578 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.515523 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.626356 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.623323 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.722643 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.722612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.824575 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.824553 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:13.922610 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:13.922586 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.116608 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.116536 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.216699 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.216662 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.318077 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.318049 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.521018 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.520991 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.641082 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.641054 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.858772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.858695 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:14.956638 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:14.956608 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.057378 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.057348 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.157187 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.157119 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.359227 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.359199 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.521921 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.521887 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.659531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.659502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:15.761051 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:15.761013 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:16.334938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:16.334905 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:16.719090 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:16.719003 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:16.920484 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:16.920455 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:17.160898 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:17.160862 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:17.417186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:17.417099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:18.015065 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.015042 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kphz6" Jul 02 11:38:18.330942 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.330893 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:18.717877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.717811 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:18.915131 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.915099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:18.941540 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.941515 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:18.943686 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:18.943665 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b6589c8-d42f-43a0-b32c-76191c220627-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skw6v\" (UID: \"9b6589c8-d42f-43a0-b32c-76191c220627\") " pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:19.106960 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:19.106937 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkpff\"" Jul 02 11:38:19.114981 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:19.114965 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skw6v" Jul 02 11:38:19.130896 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:19.130864 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:19.241033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:19.241006 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skw6v"] Jul 02 11:38:19.244219 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:19.244198 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6589c8_d42f_43a0_b32c_76191c220627.slice/crio-307fae415bd43fd7eb6806a76e0290ac949afdbff79e65ef6fb1bb615a883e8c WatchSource:0}: Error finding container 307fae415bd43fd7eb6806a76e0290ac949afdbff79e65ef6fb1bb615a883e8c: Status 404 returned error can't find the container with id 307fae415bd43fd7eb6806a76e0290ac949afdbff79e65ef6fb1bb615a883e8c Jul 02 11:38:19.321165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:19.321140 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:20.119971 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:20.119922 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:20.144280 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:20.144224 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skw6v" event={"ID":"9b6589c8-d42f-43a0-b32c-76191c220627","Type":"ContainerStarted","Data":"307fae415bd43fd7eb6806a76e0290ac949afdbff79e65ef6fb1bb615a883e8c"} Jul 02 11:38:20.312931 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:20.312894 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:20.520671 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:20.520626 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:21.562588 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.562550 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:38:21.565479 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.565456 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79x4w\" (UniqueName: \"kubernetes.io/projected/45601a67-6788-4f63-908d-f5cd64a2164e-kube-api-access-79x4w\") pod \"network-check-target-c226k\" (UID: \"45601a67-6788-4f63-908d-f5cd64a2164e\") " pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:38:21.663925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.663889 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:38:21.664081 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.663962 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:38:21.668764 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.668740 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 11:38:21.668892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.668786 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 11:38:21.677394 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.677366 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80c775cb-50d6-42d4-a9f5-3382b6d9f094-metrics-certs\") pod \"network-metrics-daemon-glt4f\" (UID: \"80c775cb-50d6-42d4-a9f5-3382b6d9f094\") " pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:38:21.677517 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.677398 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e29da5ba-f670-4597-bae8-8be15b820916-original-pull-secret\") pod \"global-pull-secret-syncer-s6l45\" (UID: \"e29da5ba-f670-4597-bae8-8be15b820916\") " pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:38:21.824099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.824025 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6l45" Jul 02 11:38:21.832008 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.831988 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qk64r\"" Jul 02 11:38:21.840178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.840151 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:38:21.925165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.925129 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slsdl\"" Jul 02 11:38:21.932722 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:21.932698 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glt4f" Jul 02 11:38:22.653816 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:22.653770 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:22.750595 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:22.750561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:22.897060 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:22.897035 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glt4f"] Jul 02 11:38:22.899815 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:22.899784 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c775cb_50d6_42d4_a9f5_3382b6d9f094.slice/crio-bf5fec2633c67ee4f095ee73991e972a72c17be548e4afd9087f5620cb58aec2 WatchSource:0}: Error finding container bf5fec2633c67ee4f095ee73991e972a72c17be548e4afd9087f5620cb58aec2: Status 404 returned error can't find the container with id bf5fec2633c67ee4f095ee73991e972a72c17be548e4afd9087f5620cb58aec2 Jul 02 11:38:23.114923 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.114861 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6l45"] Jul 02 11:38:23.117587 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:23.117553 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29da5ba_f670_4597_bae8_8be15b820916.slice/crio-82246085a99502f158a1efbf7ec0dcfba40c3a60cbf8a54e54fe2d62a8acc6a3 WatchSource:0}: Error finding container 82246085a99502f158a1efbf7ec0dcfba40c3a60cbf8a54e54fe2d62a8acc6a3: Status 404 returned error can't find the container with id 82246085a99502f158a1efbf7ec0dcfba40c3a60cbf8a54e54fe2d62a8acc6a3 Jul 02 11:38:23.118002 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.117963 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c226k"] Jul 02 11:38:23.120730 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:23.120676 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45601a67_6788_4f63_908d_f5cd64a2164e.slice/crio-791377bcfdbe9e9d376f4d91ef64b630699f551f89038f98f3d30243ce6d5052 WatchSource:0}: Error finding container 791377bcfdbe9e9d376f4d91ef64b630699f551f89038f98f3d30243ce6d5052: Status 404 returned error can't find the container with id 791377bcfdbe9e9d376f4d91ef64b630699f551f89038f98f3d30243ce6d5052 Jul 02 11:38:23.155730 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.155700 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skw6v" event={"ID":"9b6589c8-d42f-43a0-b32c-76191c220627","Type":"ContainerStarted","Data":"23b3621dcf64d438522f81618f237c6f60314d8a2419ae9389988be3e066581d"} Jul 02 11:38:23.156919 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.156895 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c226k" event={"ID":"45601a67-6788-4f63-908d-f5cd64a2164e","Type":"ContainerStarted","Data":"791377bcfdbe9e9d376f4d91ef64b630699f551f89038f98f3d30243ce6d5052"} Jul 02 11:38:23.157970 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.157950 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6l45" event={"ID":"e29da5ba-f670-4597-bae8-8be15b820916","Type":"ContainerStarted","Data":"82246085a99502f158a1efbf7ec0dcfba40c3a60cbf8a54e54fe2d62a8acc6a3"} Jul 02 11:38:23.158921 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.158902 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glt4f" event={"ID":"80c775cb-50d6-42d4-a9f5-3382b6d9f094","Type":"ContainerStarted","Data":"bf5fec2633c67ee4f095ee73991e972a72c17be548e4afd9087f5620cb58aec2"} Jul 02 11:38:23.582521 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.582489 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:23.582641 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.582571 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:23.584915 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.584894 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50bbd704-2cf4-4d3a-98d2-1796f29114a2-metrics-tls\") pod \"dns-default-nfnxc\" (UID: \"50bbd704-2cf4-4d3a-98d2-1796f29114a2\") " pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:23.584915 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.584906 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"image-registry-58d79bd58d-6nmk9\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:23.760130 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.760063 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xghqq\"" Jul 02 11:38:23.768330 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.768305 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:23.794726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.794689 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2rdqq\"" Jul 02 11:38:23.802826 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.802805 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:23.885116 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.885078 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:38:23.885241 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.885140 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:23.885241 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.885200 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:23.886099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.885994 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860ac98e-388c-47ce-a650-3517cab5b724-service-ca-bundle\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:23.894632 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.894200 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8251277-aebb-44c6-b196-a028cdbf71c7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-r9cpj\" (UID: \"f8251277-aebb-44c6-b196-a028cdbf71c7\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:38:23.895680 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.895551 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/860ac98e-388c-47ce-a650-3517cab5b724-metrics-certs\") pod \"router-default-79fc79d95c-2vnl5\" (UID: \"860ac98e-388c-47ce-a650-3517cab5b724\") " pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:23.932225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.932202 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:38:23.936091 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:23.936062 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc279d36_fa65_4a45_af0c_dacc74018a3b.slice/crio-6ee545b9f792272e041260097a9817a54fb39fafa012a37d7a66a20f8815c294 WatchSource:0}: Error finding container 6ee545b9f792272e041260097a9817a54fb39fafa012a37d7a66a20f8815c294: Status 404 returned error can't find the container with id 6ee545b9f792272e041260097a9817a54fb39fafa012a37d7a66a20f8815c294 Jul 02 11:38:23.963287 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:23.963234 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nfnxc"] Jul 02 11:38:23.975770 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:23.975714 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bbd704_2cf4_4d3a_98d2_1796f29114a2.slice/crio-ba8c5298150598191f063da592c5058d86a4dbcd2a6cd44ea7fe5bc5f490237b WatchSource:0}: Error finding container ba8c5298150598191f063da592c5058d86a4dbcd2a6cd44ea7fe5bc5f490237b: Status 404 returned error can't find the container with id ba8c5298150598191f063da592c5058d86a4dbcd2a6cd44ea7fe5bc5f490237b Jul 02 11:38:24.087779 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.087747 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:38:24.091623 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.091597 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ed44b23-16e3-4c61-80ae-dde4eecb7897-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-6t7kd\" (UID: \"8ed44b23-16e3-4c61-80ae-dde4eecb7897\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:38:24.117189 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.116948 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r7tbx\"" Jul 02 11:38:24.123876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.123617 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nl6gd\"" Jul 02 11:38:24.124530 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.124504 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:24.132016 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.131994 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" Jul 02 11:38:24.172893 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.172329 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c226k" event={"ID":"45601a67-6788-4f63-908d-f5cd64a2164e","Type":"ContainerStarted","Data":"86c9840f3f7aab032aaad8d7c0d5318e8068a879084f45e8461b6c803ccabed1"} Jul 02 11:38:24.172893 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.172577 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:38:24.174730 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.174649 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nfnxc" event={"ID":"50bbd704-2cf4-4d3a-98d2-1796f29114a2","Type":"ContainerStarted","Data":"ba8c5298150598191f063da592c5058d86a4dbcd2a6cd44ea7fe5bc5f490237b"} Jul 02 11:38:24.178954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.178453 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glt4f" event={"ID":"80c775cb-50d6-42d4-a9f5-3382b6d9f094","Type":"ContainerStarted","Data":"fa1841e9d9d7c980b00cb9036dcde66418c569e62fc699c41e5bcb783e1d34fc"} Jul 02 11:38:24.178954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.178502 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glt4f" event={"ID":"80c775cb-50d6-42d4-a9f5-3382b6d9f094","Type":"ContainerStarted","Data":"d75a8c1bc9cb233206e339c88608cf070092d66dfda6b31a0a120922ccb3e7f3"} Jul 02 11:38:24.181531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.181483 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" event={"ID":"fc279d36-fa65-4a45-af0c-dacc74018a3b","Type":"ContainerStarted","Data":"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40"} Jul 02 11:38:24.181531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.181524 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" event={"ID":"fc279d36-fa65-4a45-af0c-dacc74018a3b","Type":"ContainerStarted","Data":"6ee545b9f792272e041260097a9817a54fb39fafa012a37d7a66a20f8815c294"} Jul 02 11:38:24.182033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.182012 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:24.185650 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.185624 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skw6v" event={"ID":"9b6589c8-d42f-43a0-b32c-76191c220627","Type":"ContainerStarted","Data":"8fc3c370bc08040715b725ca0c7bc21a1bbf4356b83d224b0631319ecc4fb98f"} Jul 02 11:38:24.198616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.198559 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c226k" podStartSLOduration=67.198538071 podStartE2EDuration="1m7.198538071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:24.197707798 +0000 UTC m=+67.891742935" watchObservedRunningTime="2026-07-02 11:38:24.198538071 +0000 UTC m=+67.892573200" Jul 02 11:38:24.226289 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.226103 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" podStartSLOduration=44.22608243 podStartE2EDuration="44.22608243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:24.222872338 +0000 UTC m=+67.916907464" watchObservedRunningTime="2026-07-02 11:38:24.22608243 +0000 UTC m=+67.920117556" Jul 02 11:38:24.317010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.316825 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jdkrv\"" Jul 02 11:38:24.323627 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.323596 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" Jul 02 11:38:24.338200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.338144 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-glt4f" podStartSLOduration=66.42368425 podStartE2EDuration="1m7.338124786s" totalImagesPullingTime="914.440536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:24.24741075 +0000 UTC m=+67.941445877" watchObservedRunningTime="2026-07-02 11:38:24.338124786 +0000 UTC m=+68.032159912" Jul 02 11:38:24.339804 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.339629 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79fc79d95c-2vnl5"] Jul 02 11:38:24.342683 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:24.342654 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860ac98e_388c_47ce_a650_3517cab5b724.slice/crio-b418ca3f0cc7e1d3fe4581419b3ebd5a78cb5082bdf9380f2c121d23beac7093 WatchSource:0}: Error finding container b418ca3f0cc7e1d3fe4581419b3ebd5a78cb5082bdf9380f2c121d23beac7093: Status 404 returned error can't find the container with id b418ca3f0cc7e1d3fe4581419b3ebd5a78cb5082bdf9380f2c121d23beac7093 Jul 02 11:38:24.347938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.345474 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g"] Jul 02 11:38:24.360023 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:24.359991 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8251277_aebb_44c6_b196_a028cdbf71c7.slice/crio-65d81b0495868f36cda8c014276e59f89748e1d371a8875ba1bf60d970c6be32 WatchSource:0}: Error finding container 65d81b0495868f36cda8c014276e59f89748e1d371a8875ba1bf60d970c6be32: Status 404 returned error can't find the container with id 65d81b0495868f36cda8c014276e59f89748e1d371a8875ba1bf60d970c6be32 Jul 02 11:38:24.366285 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.366237 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj"] Jul 02 11:38:24.366380 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.366310 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g"] Jul 02 11:38:24.366438 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.366392 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.373877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.373561 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ttk4g\"" Jul 02 11:38:24.374754 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.374733 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 11:38:24.375025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.375007 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 11:38:24.375226 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.375207 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 11:38:24.375686 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.375666 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 11:38:24.438049 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.437607 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-b9qnx"] Jul 02 11:38:24.463704 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.463673 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n"] Jul 02 11:38:24.463914 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.463798 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:24.467489 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.467456 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 11:38:24.467594 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.467534 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 11:38:24.467677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.467465 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d84jf\"" Jul 02 11:38:24.484276 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.484217 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-b9qnx"] Jul 02 11:38:24.484374 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.484279 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n"] Jul 02 11:38:24.484444 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.484375 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.484786 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.484738 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:24.487828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.487482 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 11:38:24.487828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.487555 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fcqql\"" Jul 02 11:38:24.487828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.487482 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 11:38:24.493124 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.492943 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f61209f2-a944-4e0f-8b07-c5f850a32ee3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.493124 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.492996 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh54w\" (UniqueName: \"kubernetes.io/projected/f61209f2-a944-4e0f-8b07-c5f850a32ee3-kube-api-access-fh54w\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.581946 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.581712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:24.593687 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.593662 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f61209f2-a944-4e0f-8b07-c5f850a32ee3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.593846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.593697 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0251feb-74c9-45ab-b815-2e4179d5c676-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.593846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.593725 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh54w\" (UniqueName: \"kubernetes.io/projected/f61209f2-a944-4e0f-8b07-c5f850a32ee3-kube-api-access-fh54w\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.593846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.593758 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4bl\" (UniqueName: \"kubernetes.io/projected/45956546-1df3-4886-ba86-335655448d2a-kube-api-access-lt4bl\") pod \"downloads-5499b6fb8f-b9qnx\" (UID: \"45956546-1df3-4886-ba86-335655448d2a\") " pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:24.593846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.593789 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0251feb-74c9-45ab-b815-2e4179d5c676-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.597039 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.597010 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f61209f2-a944-4e0f-8b07-c5f850a32ee3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.604934 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.604909 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd"] Jul 02 11:38:24.611759 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.611712 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh54w\" (UniqueName: \"kubernetes.io/projected/f61209f2-a944-4e0f-8b07-c5f850a32ee3-kube-api-access-fh54w\") pod \"managed-serviceaccount-addon-agent-84547b87d-5fm5g\" (UID: \"f61209f2-a944-4e0f-8b07-c5f850a32ee3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.690546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.690520 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" Jul 02 11:38:24.695118 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.695091 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0251feb-74c9-45ab-b815-2e4179d5c676-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.695200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.695156 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4bl\" (UniqueName: \"kubernetes.io/projected/45956546-1df3-4886-ba86-335655448d2a-kube-api-access-lt4bl\") pod \"downloads-5499b6fb8f-b9qnx\" (UID: \"45956546-1df3-4886-ba86-335655448d2a\") " pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:24.695241 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.695202 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0251feb-74c9-45ab-b815-2e4179d5c676-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.695965 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.695943 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f0251feb-74c9-45ab-b815-2e4179d5c676-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.699945 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.699881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f0251feb-74c9-45ab-b815-2e4179d5c676-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-bzw2n\" (UID: \"f0251feb-74c9-45ab-b815-2e4179d5c676\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.718348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.718303 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4bl\" (UniqueName: \"kubernetes.io/projected/45956546-1df3-4886-ba86-335655448d2a-kube-api-access-lt4bl\") pod \"downloads-5499b6fb8f-b9qnx\" (UID: \"45956546-1df3-4886-ba86-335655448d2a\") " pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:24.780173 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.779414 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:24.781207 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.781137 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:24.801990 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.801813 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" Jul 02 11:38:24.886786 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.886755 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:24.898363 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.898294 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g"] Jul 02 11:38:24.922459 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:24.922425 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf61209f2_a944_4e0f_8b07_c5f850a32ee3.slice/crio-25799c142e38f47b2f51b734862ab6c4652b5f8d060d2b4a9f99d111444f8d29 WatchSource:0}: Error finding container 25799c142e38f47b2f51b734862ab6c4652b5f8d060d2b4a9f99d111444f8d29: Status 404 returned error can't find the container with id 25799c142e38f47b2f51b734862ab6c4652b5f8d060d2b4a9f99d111444f8d29 Jul 02 11:38:24.991264 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:24.991214 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-b9qnx"] Jul 02 11:38:24.995690 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:24.995637 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45956546_1df3_4886_ba86_335655448d2a.slice/crio-fcd81fc0012672013a1660b8157b50c98505235a606a71a08ad02eb4de332999 WatchSource:0}: Error finding container fcd81fc0012672013a1660b8157b50c98505235a606a71a08ad02eb4de332999: Status 404 returned error can't find the container with id fcd81fc0012672013a1660b8157b50c98505235a606a71a08ad02eb4de332999 Jul 02 11:38:25.014164 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.014138 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n"] Jul 02 11:38:25.019609 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:25.019570 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0251feb_74c9_45ab_b815_2e4179d5c676.slice/crio-b812a7d7f57aa74b812b2c51b7380e43d2c804f8c9692e8b19c4d2a194648469 WatchSource:0}: Error finding container b812a7d7f57aa74b812b2c51b7380e43d2c804f8c9692e8b19c4d2a194648469: Status 404 returned error can't find the container with id b812a7d7f57aa74b812b2c51b7380e43d2c804f8c9692e8b19c4d2a194648469 Jul 02 11:38:25.193062 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.192974 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" event={"ID":"f61209f2-a944-4e0f-8b07-c5f850a32ee3","Type":"ContainerStarted","Data":"25799c142e38f47b2f51b734862ab6c4652b5f8d060d2b4a9f99d111444f8d29"} Jul 02 11:38:25.195376 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.195281 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" event={"ID":"860ac98e-388c-47ce-a650-3517cab5b724","Type":"ContainerStarted","Data":"e3cd09e0e394ab8e7f314229902300aca46eefc82d3c807d56dabda127b0f428"} Jul 02 11:38:25.195376 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.195337 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" event={"ID":"860ac98e-388c-47ce-a650-3517cab5b724","Type":"ContainerStarted","Data":"b418ca3f0cc7e1d3fe4581419b3ebd5a78cb5082bdf9380f2c121d23beac7093"} Jul 02 11:38:25.197188 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.197139 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" event={"ID":"f8251277-aebb-44c6-b196-a028cdbf71c7","Type":"ContainerStarted","Data":"65d81b0495868f36cda8c014276e59f89748e1d371a8875ba1bf60d970c6be32"} Jul 02 11:38:25.198772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.198703 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" event={"ID":"8ed44b23-16e3-4c61-80ae-dde4eecb7897","Type":"ContainerStarted","Data":"87f7ecde0e69689c4f93c65f00b5e4fd03526a7b0e1dbdc2edf0af9758bf750f"} Jul 02 11:38:25.200358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.200332 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" event={"ID":"f0251feb-74c9-45ab-b815-2e4179d5c676","Type":"ContainerStarted","Data":"b812a7d7f57aa74b812b2c51b7380e43d2c804f8c9692e8b19c4d2a194648469"} Jul 02 11:38:25.202895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.202866 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-b9qnx" event={"ID":"45956546-1df3-4886-ba86-335655448d2a","Type":"ContainerStarted","Data":"fcd81fc0012672013a1660b8157b50c98505235a606a71a08ad02eb4de332999"} Jul 02 11:38:25.219744 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:25.218579 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" podStartSLOduration=34.218561815 podStartE2EDuration="34.218561815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:25.218365137 +0000 UTC m=+68.912400263" watchObservedRunningTime="2026-07-02 11:38:25.218561815 +0000 UTC m=+68.912596941" Jul 02 11:38:26.096028 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.095970 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:38:26.117437 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.115238 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:38:26.117437 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.115368 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.122163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.121561 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d5ddw\"" Jul 02 11:38:26.122163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.121705 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 11:38:26.122163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.121860 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 11:38:26.122163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.122009 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 11:38:26.122163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.122087 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 11:38:26.122702 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.122242 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 11:38:26.125666 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.125618 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:26.129044 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.128927 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:26.131062 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.130951 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:26.207304 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.207304 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207163 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.207304 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207206 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.207304 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207278 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.207628 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207353 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.207628 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.207399 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9zn\" (UniqueName: \"kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.209165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.209085 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:26.210787 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.210764 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79fc79d95c-2vnl5" Jul 02 11:38:26.230976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.230889 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.309768 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.309814 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.309882 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9zn\" (UniqueName: \"kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.309981 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.310008 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.311664 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.310082 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.312074 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.311888 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.312343 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.312319 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.312480 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.312438 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.318902 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.318858 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.323809 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.323771 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.331201 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.331157 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9zn\" (UniqueName: \"kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn\") pod \"console-7788d48bc7-f22p4\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.431112 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.430985 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:26.432812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.432747 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:26.533339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:26.533283 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:28.060218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.060184 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:38:28.088673 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.088639 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:28.109767 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.109740 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:38:28.109925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.109874 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.118404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.118380 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 11:38:28.189330 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.189296 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:28.226837 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.226803 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8jk\" (UniqueName: \"kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227008 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.226867 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227008 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.226896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227008 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.226982 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.227026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.227054 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.227178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.227094 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.327972 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.327889 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.327972 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.327959 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8jk\" (UniqueName: \"kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.328210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328018 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.328210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328042 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.328503 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328468 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.328593 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328532 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.328593 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328564 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.329139 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328878 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.329139 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.328894 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.329367 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.329323 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.329483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.329384 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.331773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.331751 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.331987 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.331945 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.339899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.339856 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8jk\" (UniqueName: \"kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk\") pod \"console-6b9c859dbd-z4w4k\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:28.422433 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:28.422183 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:29.140266 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:29.140217 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:29.204908 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:29.204866 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:30.405909 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:30.405653 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:32.660303 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:32.658332 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:38:32.670662 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:32.670540 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d917e_bfdc_40e1_81b3_db0078ad356d.slice/crio-bab97d34566d24f3af61c57e2c87c7f6c3184ca5b45362727e033382040cd295 WatchSource:0}: Error finding container bab97d34566d24f3af61c57e2c87c7f6c3184ca5b45362727e033382040cd295: Status 404 returned error can't find the container with id bab97d34566d24f3af61c57e2c87c7f6c3184ca5b45362727e033382040cd295 Jul 02 11:38:32.684758 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:32.684712 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:38:32.689152 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:32.689113 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603a9e2e_cd4b_4bba_b1c6_603096b7f0df.slice/crio-f1d9535a57ee59297b31abb811b0a29ebe060f24b672471f51fe38a849402c19 WatchSource:0}: Error finding container f1d9535a57ee59297b31abb811b0a29ebe060f24b672471f51fe38a849402c19: Status 404 returned error can't find the container with id f1d9535a57ee59297b31abb811b0a29ebe060f24b672471f51fe38a849402c19 Jul 02 11:38:33.085360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.085307 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.145014 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.144957 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.228807 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.228731 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.246599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.246560 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skw6v" event={"ID":"9b6589c8-d42f-43a0-b32c-76191c220627","Type":"ContainerStarted","Data":"d7c1283122154f5600f74c9e87ee593a19aefa36bbd56a68b2d2bfe0e5dcebca"} Jul 02 11:38:33.248291 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.248216 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c859dbd-z4w4k" event={"ID":"f45d917e-bfdc-40e1-81b3-db0078ad356d","Type":"ContainerStarted","Data":"bab97d34566d24f3af61c57e2c87c7f6c3184ca5b45362727e033382040cd295"} Jul 02 11:38:33.250354 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.250332 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" event={"ID":"f8251277-aebb-44c6-b196-a028cdbf71c7","Type":"ContainerStarted","Data":"79115a17951cd2e9957df73b4fa9e9b6059abdc838bee0a2678ba6fb6e980a3e"} Jul 02 11:38:33.252618 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.252594 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788d48bc7-f22p4" event={"ID":"603a9e2e-cd4b-4bba-b1c6-603096b7f0df","Type":"ContainerStarted","Data":"f1d9535a57ee59297b31abb811b0a29ebe060f24b672471f51fe38a849402c19"} Jul 02 11:38:33.255007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.254982 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" event={"ID":"8ed44b23-16e3-4c61-80ae-dde4eecb7897","Type":"ContainerStarted","Data":"57511f605e056331329653e70288e89dd8f412c034d295038639793b23cd97c4"} Jul 02 11:38:33.255122 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.255030 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" event={"ID":"8ed44b23-16e3-4c61-80ae-dde4eecb7897","Type":"ContainerStarted","Data":"228dce902b02fc830b0868b4e813b0b83835bacee21ca4018f268b8619cecc42"} Jul 02 11:38:33.257016 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.256988 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6l45" event={"ID":"e29da5ba-f670-4597-bae8-8be15b820916","Type":"ContainerStarted","Data":"d4cf4d0a16a48e2c7346efcaf06ad0671975a912945a98f30d163fa2a721bb52"} Jul 02 11:38:33.260142 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.260116 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nfnxc" event={"ID":"50bbd704-2cf4-4d3a-98d2-1796f29114a2","Type":"ContainerStarted","Data":"57e4d4930a5442f8546a106875f8f9d9ba7604a4668fa57ecc9e9e227e0c5ca7"} Jul 02 11:38:33.260240 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.260156 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nfnxc" event={"ID":"50bbd704-2cf4-4d3a-98d2-1796f29114a2","Type":"ContainerStarted","Data":"0b7bf4b0fca9f4ef7bd64536c4ca25555f98c84d740e49d1ec5300bc351fee26"} Jul 02 11:38:33.260634 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.260607 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:33.262885 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.262823 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" event={"ID":"f0251feb-74c9-45ab-b815-2e4179d5c676","Type":"ContainerStarted","Data":"bdb22bd7583787dddd7332881efd1825a8e7f5ca3f1ef9ed39f8f209e085ebed"} Jul 02 11:38:33.272859 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.272814 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-skw6v" podStartSLOduration=17.201722592 podStartE2EDuration="30.272797493s" totalImagesPullingTime="13.071074901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:38:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.271458794 +0000 UTC m=+76.965493932" watchObservedRunningTime="2026-07-02 11:38:33.272797493 +0000 UTC m=+76.966832614" Jul 02 11:38:33.322759 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.322679 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nfnxc" podStartSLOduration=33.930711599 podStartE2EDuration="42.322661408s" totalImagesPullingTime="8.391949809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.295472803 +0000 UTC m=+76.989507929" watchObservedRunningTime="2026-07-02 11:38:33.322661408 +0000 UTC m=+77.016696533" Jul 02 11:38:33.324437 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.324390 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-r9cpj" podStartSLOduration=34.220672125 podStartE2EDuration="42.324372978s" totalImagesPullingTime="8.103700853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.321715151 +0000 UTC m=+77.015750273" watchObservedRunningTime="2026-07-02 11:38:33.324372978 +0000 UTC m=+77.018408104" Jul 02 11:38:33.359987 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.359680 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s6l45" podStartSLOduration=66.991255105 podStartE2EDuration="1m16.359662287s" totalImagesPullingTime="9.368407182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.359491256 +0000 UTC m=+77.053526379" watchObservedRunningTime="2026-07-02 11:38:33.359662287 +0000 UTC m=+77.053697414" Jul 02 11:38:33.389300 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.388208 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-6t7kd" podStartSLOduration=33.589478064 podStartE2EDuration="41.388187071s" totalImagesPullingTime="7.798709007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.38806122 +0000 UTC m=+77.082096345" watchObservedRunningTime="2026-07-02 11:38:33.388187071 +0000 UTC m=+77.082222216" Jul 02 11:38:33.408350 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.408301 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-bzw2n" podStartSLOduration=1.997556387 podStartE2EDuration="9.408283143s" totalImagesPullingTime="7.410726756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:33.407679708 +0000 UTC m=+77.101714824" watchObservedRunningTime="2026-07-02 11:38:33.408283143 +0000 UTC m=+77.102318270" Jul 02 11:38:33.509127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.509050 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.611310 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.609671 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.714392 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.714328 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:33.849705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:33.849641 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:34.373070 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:34.373011 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:35.856743 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:35.856703 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:35.957658 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:35.957615 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:36.186229 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:36.186148 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:36.281589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:36.281549 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" event={"ID":"f61209f2-a944-4e0f-8b07-c5f850a32ee3","Type":"ContainerStarted","Data":"fd60b8afb910b792ffcd3a79b8268ea52d9afad002fb6482529c9d250bd75de1"} Jul 02 11:38:36.287454 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:36.287359 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:36.300957 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:36.300905 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84547b87d-5fm5g" podStartSLOduration=1.8639801870000001 podStartE2EDuration="12.300885224s" totalImagesPullingTime="10.436905037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:36.299648765 +0000 UTC m=+79.993683891" watchObservedRunningTime="2026-07-02 11:38:36.300885224 +0000 UTC m=+79.994920349" Jul 02 11:38:37.288353 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:37.288314 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c859dbd-z4w4k" event={"ID":"f45d917e-bfdc-40e1-81b3-db0078ad356d","Type":"ContainerStarted","Data":"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0"} Jul 02 11:38:37.290342 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:37.290309 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788d48bc7-f22p4" event={"ID":"603a9e2e-cd4b-4bba-b1c6-603096b7f0df","Type":"ContainerStarted","Data":"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d"} Jul 02 11:38:37.308907 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:37.308860 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9c859dbd-z4w4k" podStartSLOduration=5.279413996 podStartE2EDuration="9.308845613s" totalImagesPullingTime="4.029431617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:37.307364762 +0000 UTC m=+81.001399887" watchObservedRunningTime="2026-07-02 11:38:37.308845613 +0000 UTC m=+81.002880739" Jul 02 11:38:37.325436 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:37.325392 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7788d48bc7-f22p4" podStartSLOduration=7.319347018 podStartE2EDuration="11.325375461s" totalImagesPullingTime="4.006028443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:37.324815532 +0000 UTC m=+81.018850681" watchObservedRunningTime="2026-07-02 11:38:37.325375461 +0000 UTC m=+81.019410585" Jul 02 11:38:38.420742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.420703 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:38.422365 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.422343 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:38.422460 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.422390 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:38.427980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.427959 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:38.548161 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.548127 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:38.649559 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:38.649508 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:39.264773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.264636 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:39.301997 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.301972 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:38:39.345689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.345645 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:39.359717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.359684 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:38:39.668623 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.668579 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:39.770132 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:39.770085 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:40.220479 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:40.220442 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:40.318195 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:40.318123 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:41.337960 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:41.337928 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:41.438828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:41.438791 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:41.784181 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:41.784113 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:41.885040 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:41.885006 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:42.888930 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:42.888867 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:44.162603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:44.162566 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:44.234637 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:44.234601 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:44.278487 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:44.278461 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nfnxc" Jul 02 11:38:45.272948 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:45.272890 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:45.373726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:45.373612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.213874 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.213844 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:38:46.358822 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.358792 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:38:46.431087 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.431058 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:38:46.447688 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.447660 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.525681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.525651 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.600663 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.600620 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.701867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.701838 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.807587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.807520 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:46.921914 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:46.921886 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:47.341457 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:47.341381 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-b9qnx" event={"ID":"45956546-1df3-4886-ba86-335655448d2a","Type":"ContainerStarted","Data":"ee389e313bb75ceb1b52a3170c6aef51abb2600ed69c2a605ffce513852398d2"} Jul 02 11:38:47.341614 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:47.341600 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:47.343049 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:47.343023 2551 patch_prober.go:28] interesting pod/downloads-5499b6fb8f-b9qnx container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body= Jul 02 11:38:47.343153 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:47.343071 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5499b6fb8f-b9qnx" podUID="45956546-1df3-4886-ba86-335655448d2a" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" Jul 02 11:38:47.367780 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:47.367741 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-b9qnx" podStartSLOduration=1.375505846 podStartE2EDuration="23.367727821s" totalImagesPullingTime="21.992221975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:47.365529764 +0000 UTC m=+91.059564888" watchObservedRunningTime="2026-07-02 11:38:47.367727821 +0000 UTC m=+91.061762968" Jul 02 11:38:48.365800 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:48.365765 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-b9qnx" Jul 02 11:38:50.406653 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.406618 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.508083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.508048 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.618448 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.618405 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.666482 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.666397 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h988x"] Jul 02 11:38:50.700745 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.700698 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.701208 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.701188 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.703702 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.703666 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 11:38:50.703702 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.703681 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 11:38:50.704146 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.704122 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkbb2\"" Jul 02 11:38:50.704240 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.704167 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 11:38:50.704771 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.704748 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 11:38:50.785558 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.785525 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.827484 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827456 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-sys\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827525 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-textfile\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827610 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-wtmp\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827802 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827646 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-root\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827802 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-metrics-client-ca\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827802 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827722 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nrc7\" (UniqueName: \"kubernetes.io/projected/0aa8df69-8765-449e-8047-b15f5311daa8-kube-api-access-2nrc7\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.827802 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.827756 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.902724 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.902684 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:50.928769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928708 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-wtmp\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928749 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-root\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-metrics-client-ca\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928855 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-root\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928885 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nrc7\" (UniqueName: \"kubernetes.io/projected/0aa8df69-8765-449e-8047-b15f5311daa8-kube-api-access-2nrc7\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928901 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-wtmp\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.928959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928919 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928963 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-sys\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.928987 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929024 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-textfile\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:50.929055 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:38:50.929140 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls podName:0aa8df69-8765-449e-8047-b15f5311daa8 nodeName:}" failed. No retries permitted until 2026-07-02 11:38:51.429119214 +0000 UTC m=+95.123154317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls") pod "node-exporter-h988x" (UID: "0aa8df69-8765-449e-8047-b15f5311daa8") : secret "node-exporter-tls" not found Jul 02 11:38:50.929198 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929058 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0aa8df69-8765-449e-8047-b15f5311daa8-sys\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929394 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-textfile\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929457 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-metrics-client-ca\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.929678 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.929586 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-accelerators-collector-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.931776 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.931752 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:50.939997 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:50.939975 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nrc7\" (UniqueName: \"kubernetes.io/projected/0aa8df69-8765-449e-8047-b15f5311daa8-kube-api-access-2nrc7\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:51.329861 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.329811 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:51.432753 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.432704 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:51.433625 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.433595 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:51.436197 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.436171 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0aa8df69-8765-449e-8047-b15f5311daa8-node-exporter-tls\") pod \"node-exporter-h988x\" (UID: \"0aa8df69-8765-449e-8047-b15f5311daa8\") " pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:51.605927 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.605851 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:51.612777 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.612747 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h988x" Jul 02 11:38:51.658386 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:51.658359 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa8df69_8765_449e_8047_b15f5311daa8.slice/crio-cc70ff41e8bec4ca5e2a0fb278280b3e47fddcfbd02c295f8ea866ab51cabdd3 WatchSource:0}: Error finding container cc70ff41e8bec4ca5e2a0fb278280b3e47fddcfbd02c295f8ea866ab51cabdd3: Status 404 returned error can't find the container with id cc70ff41e8bec4ca5e2a0fb278280b3e47fddcfbd02c295f8ea866ab51cabdd3 Jul 02 11:38:51.709106 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.709056 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:51.788936 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.788905 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:51.905716 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:51.905638 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:52.088188 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:52.088131 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:52.367915 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:52.367830 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h988x" event={"ID":"0aa8df69-8765-449e-8047-b15f5311daa8","Type":"ContainerStarted","Data":"cc70ff41e8bec4ca5e2a0fb278280b3e47fddcfbd02c295f8ea866ab51cabdd3"} Jul 02 11:38:53.374935 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.374896 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h988x" event={"ID":"0aa8df69-8765-449e-8047-b15f5311daa8","Type":"ContainerStarted","Data":"8b47f14fc404a3f28a8566ab519334e4be12ed2335c006aaf64126b8e0857a55"} Jul 02 11:38:53.440853 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.440815 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:53.665761 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.665728 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:53.746383 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.746350 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:53.820686 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.820645 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:53.957873 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:53.957787 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:54.381784 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:54.381745 2551 generic.go:356] "Generic (PLEG): container finished" podID="0aa8df69-8765-449e-8047-b15f5311daa8" containerID="8b47f14fc404a3f28a8566ab519334e4be12ed2335c006aaf64126b8e0857a55" exitCode=0 Jul 02 11:38:54.382239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:54.381854 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h988x" event={"ID":"0aa8df69-8765-449e-8047-b15f5311daa8","Type":"ContainerDied","Data":"8b47f14fc404a3f28a8566ab519334e4be12ed2335c006aaf64126b8e0857a55"} Jul 02 11:38:55.205630 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.205590 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c226k" Jul 02 11:38:55.390073 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.390040 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h988x" event={"ID":"0aa8df69-8765-449e-8047-b15f5311daa8","Type":"ContainerStarted","Data":"0634f1cf048075f3cf1d0e2e469cb9b0d5ae4906b1548e506ffb53c5857204c2"} Jul 02 11:38:55.390504 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.390098 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h988x" event={"ID":"0aa8df69-8765-449e-8047-b15f5311daa8","Type":"ContainerStarted","Data":"0f1a307c4893783119964512a5724e7a07319d29bcb44727fb811ec9a25a167a"} Jul 02 11:38:55.415714 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.415658 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h988x" podStartSLOduration=3.769953252 podStartE2EDuration="5.415636564s" totalImagesPullingTime="1.546243714s" totalInitContainerRuntime="99.439598ms" isStatefulPod=true podCreationTimestamp="2026-07-02 11:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:55.41505801 +0000 UTC m=+99.109093162" watchObservedRunningTime="2026-07-02 11:38:55.415636564 +0000 UTC m=+99.109671690" Jul 02 11:38:55.457738 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.457661 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:55.466050 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.466020 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:38:55.499223 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.499196 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:38:55.499369 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.499318 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.584023 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.583965 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:55.678567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678531 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678624 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678690 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5b69\" (UniqueName: \"kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678910 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.678910 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.678735 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.681587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.681551 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:55.780000 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.779970 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780014 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780037 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5b69\" (UniqueName: \"kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780064 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780098 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780411 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780286 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.780411 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780363 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.781011 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780984 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.781105 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.781008 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.781105 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.780984 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.781218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.781157 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.782934 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.782913 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.783098 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.783080 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.788755 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.788730 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5b69\" (UniqueName: \"kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69\") pod \"console-6f88c5bc7c-vbnbp\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.810558 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.810537 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:38:55.918966 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.918929 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:55.985002 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:55.984971 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:38:55.987483 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:38:55.987455 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2271db0_8066_4585_9f10_e78948378910.slice/crio-c2f6ac91315016c712894fd25644039d5e5b261908118e409e1ed4e04b1ac697 WatchSource:0}: Error finding container c2f6ac91315016c712894fd25644039d5e5b261908118e409e1ed4e04b1ac697: Status 404 returned error can't find the container with id c2f6ac91315016c712894fd25644039d5e5b261908118e409e1ed4e04b1ac697 Jul 02 11:38:56.162699 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.162663 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:56.265220 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.265186 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:56.396012 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.395930 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f88c5bc7c-vbnbp" event={"ID":"e2271db0-8066-4585-9f10-e78948378910","Type":"ContainerStarted","Data":"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff"} Jul 02 11:38:56.396012 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.395988 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f88c5bc7c-vbnbp" event={"ID":"e2271db0-8066-4585-9f10-e78948378910","Type":"ContainerStarted","Data":"c2f6ac91315016c712894fd25644039d5e5b261908118e409e1ed4e04b1ac697"} Jul 02 11:38:56.416749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.416691 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f88c5bc7c-vbnbp" podStartSLOduration=1.416672616 podStartE2EDuration="1.416672616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:38:56.415370752 +0000 UTC m=+100.109405878" watchObservedRunningTime="2026-07-02 11:38:56.416672616 +0000 UTC m=+100.110707743" Jul 02 11:38:56.977418 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:56.977386 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:59.143058 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:59.143022 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:38:59.244429 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:38:59.244386 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:02.452708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:02.452674 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:02.523140 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:02.523104 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:04.389901 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.389859 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7788d48bc7-f22p4" podUID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" containerName="console" containerID="cri-o://765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d" gracePeriod=15 Jul 02 11:39:04.655115 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.655061 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:39:04.752239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752212 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752451 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752243 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752451 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752275 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9zn\" (UniqueName: \"kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752451 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752303 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752451 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752425 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752494 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert\") pod \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\" (UID: \"603a9e2e-cd4b-4bba-b1c6-603096b7f0df\") " Jul 02 11:39:04.752677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752628 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config" (OuterVolumeSpecName: "console-config") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:04.752677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752644 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca" (OuterVolumeSpecName: "service-ca") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:04.752796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752781 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:04.752847 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752799 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:04.752955 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.752928 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:04.754778 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.754736 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:04.754778 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.754761 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn" (OuterVolumeSpecName: "kube-api-access-pt9zn") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "kube-api-access-pt9zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:39:04.754908 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.754783 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "603a9e2e-cd4b-4bba-b1c6-603096b7f0df" (UID: "603a9e2e-cd4b-4bba-b1c6-603096b7f0df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:04.853181 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.853156 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:04.853322 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.853182 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:04.853322 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.853195 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:04.853322 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:04.853209 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9zn\" (UniqueName: \"kubernetes.io/projected/603a9e2e-cd4b-4bba-b1c6-603096b7f0df-kube-api-access-pt9zn\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:05.434058 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.434020 2551 generic.go:356] "Generic (PLEG): container finished" podID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" containerID="765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d" exitCode=0 Jul 02 11:39:05.434603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.434066 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7788d48bc7-f22p4" Jul 02 11:39:05.434603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.434095 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788d48bc7-f22p4" event={"ID":"603a9e2e-cd4b-4bba-b1c6-603096b7f0df","Type":"ContainerDied","Data":"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d"} Jul 02 11:39:05.434603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.434142 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7788d48bc7-f22p4" event={"ID":"603a9e2e-cd4b-4bba-b1c6-603096b7f0df","Type":"ContainerDied","Data":"f1d9535a57ee59297b31abb811b0a29ebe060f24b672471f51fe38a849402c19"} Jul 02 11:39:05.434603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.434172 2551 scope.go:117] "RemoveContainer" containerID="765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d" Jul 02 11:39:05.443899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.443876 2551 scope.go:117] "RemoveContainer" containerID="765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d" Jul 02 11:39:05.444163 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:39:05.444135 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d\": container with ID starting with 765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d not found: ID does not exist" containerID="765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d" Jul 02 11:39:05.444224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.444170 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d"} err="failed to get container status \"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d\": rpc error: code = NotFound desc = could not find container \"765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d\": container with ID starting with 765afd44f626776ebfaa16e623b82cc955b0b22603d60b30003c8b238531994d not found: ID does not exist" Jul 02 11:39:05.451432 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.451412 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:39:05.455889 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.455870 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7788d48bc7-f22p4"] Jul 02 11:39:05.811589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.811559 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:39:05.811823 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.811630 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:39:05.816284 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:05.816238 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:39:06.442709 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:06.442683 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:39:06.492646 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:06.492617 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:39:06.658244 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:06.658214 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:06.748312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:06.748225 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:06.816772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:06.816746 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" path="/var/lib/kubelet/pods/603a9e2e-cd4b-4bba-b1c6-603096b7f0df/volumes" Jul 02 11:39:07.443839 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:07.443801 2551 generic.go:356] "Generic (PLEG): container finished" podID="12d29bd1-e949-4705-970c-dfc090e2c45a" containerID="095b1392e423dfd1d7c5bcfcb9bffc052ca446f65c269438419c70e2748abdc6" exitCode=0 Jul 02 11:39:07.444309 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:07.443879 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" event={"ID":"12d29bd1-e949-4705-970c-dfc090e2c45a","Type":"ContainerDied","Data":"095b1392e423dfd1d7c5bcfcb9bffc052ca446f65c269438419c70e2748abdc6"} Jul 02 11:39:07.444402 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:07.444384 2551 scope.go:117] "RemoveContainer" containerID="095b1392e423dfd1d7c5bcfcb9bffc052ca446f65c269438419c70e2748abdc6" Jul 02 11:39:08.449740 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:08.449708 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-b2z78" event={"ID":"12d29bd1-e949-4705-970c-dfc090e2c45a","Type":"ContainerStarted","Data":"eca8ac3db986b792f786cb683a704c0423a9918627b89595e44362c779a9cb7c"} Jul 02 11:39:11.382226 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.382184 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" podUID="fc279d36-fa65-4a45-af0c-dacc74018a3b" containerName="registry" containerID="cri-o://1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40" gracePeriod=30 Jul 02 11:39:11.656435 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.656380 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:39:11.705581 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705554 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705593 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705626 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmzxx\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705647 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705669 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705692 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.705729 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705727 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.706033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.705762 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca\") pod \"fc279d36-fa65-4a45-af0c-dacc74018a3b\" (UID: \"fc279d36-fa65-4a45-af0c-dacc74018a3b\") " Jul 02 11:39:11.706226 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.706200 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:11.706343 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.706286 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:11.708139 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.708095 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:39:11.708280 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.708188 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:39:11.708343 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.708280 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:11.708343 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.708328 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx" (OuterVolumeSpecName: "kube-api-access-nmzxx") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "kube-api-access-nmzxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:39:11.708416 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.708356 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:11.714017 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.713995 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fc279d36-fa65-4a45-af0c-dacc74018a3b" (UID: "fc279d36-fa65-4a45-af0c-dacc74018a3b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:39:11.806631 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806609 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc279d36-fa65-4a45-af0c-dacc74018a3b-ca-trust-extracted\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806631 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806630 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-bound-sa-token\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806640 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmzxx\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-kube-api-access-nmzxx\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806649 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-image-registry-private-configuration\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806661 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-certificates\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806669 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc279d36-fa65-4a45-af0c-dacc74018a3b-registry-tls\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806678 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc279d36-fa65-4a45-af0c-dacc74018a3b-installation-pull-secrets\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:11.806756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:11.806687 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc279d36-fa65-4a45-af0c-dacc74018a3b-trusted-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:12.471474 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.471439 2551 generic.go:356] "Generic (PLEG): container finished" podID="fc279d36-fa65-4a45-af0c-dacc74018a3b" containerID="1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40" exitCode=0 Jul 02 11:39:12.471988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.471494 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" Jul 02 11:39:12.471988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.471526 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" event={"ID":"fc279d36-fa65-4a45-af0c-dacc74018a3b","Type":"ContainerDied","Data":"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40"} Jul 02 11:39:12.471988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.471591 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d79bd58d-6nmk9" event={"ID":"fc279d36-fa65-4a45-af0c-dacc74018a3b","Type":"ContainerDied","Data":"6ee545b9f792272e041260097a9817a54fb39fafa012a37d7a66a20f8815c294"} Jul 02 11:39:12.471988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.471609 2551 scope.go:117] "RemoveContainer" containerID="1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40" Jul 02 11:39:12.480131 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.480111 2551 scope.go:117] "RemoveContainer" containerID="1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40" Jul 02 11:39:12.480379 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:39:12.480360 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40\": container with ID starting with 1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40 not found: ID does not exist" containerID="1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40" Jul 02 11:39:12.480437 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.480386 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40"} err="failed to get container status \"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40\": rpc error: code = NotFound desc = could not find container \"1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40\": container with ID starting with 1ba70344158d3ebf3c6e149a8eaf1718347ad48ac4ca0ebbf4737729a0172b40 not found: ID does not exist" Jul 02 11:39:12.500166 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.500144 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:39:12.506049 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.506030 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58d79bd58d-6nmk9"] Jul 02 11:39:12.816948 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:12.816900 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc279d36-fa65-4a45-af0c-dacc74018a3b" path="/var/lib/kubelet/pods/fc279d36-fa65-4a45-af0c-dacc74018a3b/volumes" Jul 02 11:39:14.145389 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:14.145355 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:14.212456 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:14.212424 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:22.510958 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:22.510882 2551 generic.go:356] "Generic (PLEG): container finished" podID="c9249aee-3e1f-4e45-81ed-a6bb8f6a158c" containerID="ae3a9896f555795bb9ff3bfe2d7221a47ab9d6bc6af17d602a0b9133ddfb3f26" exitCode=0 Jul 02 11:39:22.511316 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:22.510955 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" event={"ID":"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c","Type":"ContainerDied","Data":"ae3a9896f555795bb9ff3bfe2d7221a47ab9d6bc6af17d602a0b9133ddfb3f26"} Jul 02 11:39:22.511358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:22.511323 2551 scope.go:117] "RemoveContainer" containerID="ae3a9896f555795bb9ff3bfe2d7221a47ab9d6bc6af17d602a0b9133ddfb3f26" Jul 02 11:39:23.516823 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:23.516784 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-dgzqf" event={"ID":"c9249aee-3e1f-4e45-81ed-a6bb8f6a158c","Type":"ContainerStarted","Data":"363cd1b488d75393b2c4447fb98b1cd25568197be7761b76167d83dd0ec63ad5"} Jul 02 11:39:30.032883 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:30.032842 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:30.091979 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:30.091946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:39:31.513647 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.513604 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b9c859dbd-z4w4k" podUID="f45d917e-bfdc-40e1-81b3-db0078ad356d" containerName="console" containerID="cri-o://f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0" gracePeriod=15 Jul 02 11:39:31.803562 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.803541 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:39:31.856658 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856632 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856667 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856701 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856729 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856761 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz8jk\" (UniqueName: \"kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856989 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856785 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.856989 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.856807 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config\") pod \"f45d917e-bfdc-40e1-81b3-db0078ad356d\" (UID: \"f45d917e-bfdc-40e1-81b3-db0078ad356d\") " Jul 02 11:39:31.857089 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.857026 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:31.857089 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.857062 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:31.857272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.857224 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:31.857325 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.857275 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config" (OuterVolumeSpecName: "console-config") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:39:31.858752 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.858727 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:31.858905 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.858879 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:39:31.858951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.858910 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk" (OuterVolumeSpecName: "kube-api-access-zz8jk") pod "f45d917e-bfdc-40e1-81b3-db0078ad356d" (UID: "f45d917e-bfdc-40e1-81b3-db0078ad356d"). InnerVolumeSpecName "kube-api-access-zz8jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:39:31.957693 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957667 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957693 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957691 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957829 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957706 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f45d917e-bfdc-40e1-81b3-db0078ad356d-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957829 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957718 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957829 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957730 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957829 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957744 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f45d917e-bfdc-40e1-81b3-db0078ad356d-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:31.957829 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:31.957755 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz8jk\" (UniqueName: \"kubernetes.io/projected/f45d917e-bfdc-40e1-81b3-db0078ad356d-kube-api-access-zz8jk\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:39:32.551854 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.551815 2551 generic.go:356] "Generic (PLEG): container finished" podID="b8854ed4-6b8f-43b4-8534-a1b04f20a952" containerID="2939fcfe7c5c1a04f57d1e8c6a3d83060fba489012a5b462f26cc8cd735b6be1" exitCode=0 Jul 02 11:39:32.552316 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.551886 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" event={"ID":"b8854ed4-6b8f-43b4-8534-a1b04f20a952","Type":"ContainerDied","Data":"2939fcfe7c5c1a04f57d1e8c6a3d83060fba489012a5b462f26cc8cd735b6be1"} Jul 02 11:39:32.552316 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.552228 2551 scope.go:117] "RemoveContainer" containerID="2939fcfe7c5c1a04f57d1e8c6a3d83060fba489012a5b462f26cc8cd735b6be1" Jul 02 11:39:32.553240 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.553217 2551 generic.go:356] "Generic (PLEG): container finished" podID="f45d917e-bfdc-40e1-81b3-db0078ad356d" containerID="f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0" exitCode=0 Jul 02 11:39:32.553339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.553272 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c859dbd-z4w4k" event={"ID":"f45d917e-bfdc-40e1-81b3-db0078ad356d","Type":"ContainerDied","Data":"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0"} Jul 02 11:39:32.553339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.553290 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9c859dbd-z4w4k" Jul 02 11:39:32.553339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.553315 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9c859dbd-z4w4k" event={"ID":"f45d917e-bfdc-40e1-81b3-db0078ad356d","Type":"ContainerDied","Data":"bab97d34566d24f3af61c57e2c87c7f6c3184ca5b45362727e033382040cd295"} Jul 02 11:39:32.553433 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.553341 2551 scope.go:117] "RemoveContainer" containerID="f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0" Jul 02 11:39:32.561753 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.561734 2551 scope.go:117] "RemoveContainer" containerID="f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0" Jul 02 11:39:32.561992 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:39:32.561973 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0\": container with ID starting with f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0 not found: ID does not exist" containerID="f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0" Jul 02 11:39:32.562049 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.562004 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0"} err="failed to get container status \"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0\": rpc error: code = NotFound desc = could not find container \"f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0\": container with ID starting with f3f637dfe7d823022c3cb4f1391660b2334a6aac9344cc9d51808b1d61f2b1e0 not found: ID does not exist" Jul 02 11:39:32.587320 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.587290 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:39:32.594491 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.594469 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9c859dbd-z4w4k"] Jul 02 11:39:32.817305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:32.817209 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45d917e-bfdc-40e1-81b3-db0078ad356d" path="/var/lib/kubelet/pods/f45d917e-bfdc-40e1-81b3-db0078ad356d/volumes" Jul 02 11:39:33.559289 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:39:33.559237 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-flkdv" event={"ID":"b8854ed4-6b8f-43b4-8534-a1b04f20a952","Type":"ContainerStarted","Data":"c56c30b32d54b8a7144e85a124d1b71f06e8e8ecf3379d1e7df34f02ae7b84f3"} Jul 02 11:40:10.016768 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:10.016658 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:10.215536 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:10.215503 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:19.896892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.896862 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897152 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45d917e-bfdc-40e1-81b3-db0078ad356d" containerName="console" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897163 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45d917e-bfdc-40e1-81b3-db0078ad356d" containerName="console" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897175 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc279d36-fa65-4a45-af0c-dacc74018a3b" containerName="registry" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897180 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc279d36-fa65-4a45-af0c-dacc74018a3b" containerName="registry" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897187 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" containerName="console" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897193 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" containerName="console" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897241 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc279d36-fa65-4a45-af0c-dacc74018a3b" containerName="registry" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897265 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="603a9e2e-cd4b-4bba-b1c6-603096b7f0df" containerName="console" Jul 02 11:40:19.897312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.897271 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45d917e-bfdc-40e1-81b3-db0078ad356d" containerName="console" Jul 02 11:40:19.899567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.899546 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.922794 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.922767 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:40:19.969463 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.969439 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:19.992682 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992655 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992783 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992686 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992783 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992708 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992783 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992731 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992950 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992799 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992950 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992843 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:19.992950 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:19.992888 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfbm\" (UniqueName: \"kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.070245 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.070220 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:20.093190 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093168 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093197 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093217 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093270 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093480 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093309 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093480 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093344 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.093480 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093383 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfbm\" (UniqueName: \"kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.094024 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.093997 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.094163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.094143 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.094237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.094182 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.094237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.094222 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.095840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.095821 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.095923 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.095850 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.102954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.102931 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfbm\" (UniqueName: \"kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm\") pod \"console-788cf7d958-7lzhd\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.209748 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.209701 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:20.337991 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.337961 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:40:20.341046 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:40:20.341020 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode203a9f9_fb8b_4f9e_bfd3_64505c0a50c0.slice/crio-33f3a8172569b6d257b8ba956258c4ad310e7258bb6aa9192185a16140e64dfb WatchSource:0}: Error finding container 33f3a8172569b6d257b8ba956258c4ad310e7258bb6aa9192185a16140e64dfb: Status 404 returned error can't find the container with id 33f3a8172569b6d257b8ba956258c4ad310e7258bb6aa9192185a16140e64dfb Jul 02 11:40:20.732864 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.732830 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788cf7d958-7lzhd" event={"ID":"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0","Type":"ContainerStarted","Data":"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471"} Jul 02 11:40:20.733034 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.732878 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788cf7d958-7lzhd" event={"ID":"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0","Type":"ContainerStarted","Data":"33f3a8172569b6d257b8ba956258c4ad310e7258bb6aa9192185a16140e64dfb"} Jul 02 11:40:20.755895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.755854 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788cf7d958-7lzhd" podStartSLOduration=1.755839677 podStartE2EDuration="1.755839677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:40:20.754053192 +0000 UTC m=+184.448088309" watchObservedRunningTime="2026-07-02 11:40:20.755839677 +0000 UTC m=+184.449874803" Jul 02 11:40:20.912791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:20.912755 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:25.389309 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:25.389264 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:25.468412 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:25.468378 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:30.210717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.210684 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:30.211084 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.210745 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:30.215306 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.215284 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:30.773762 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.773733 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:40:30.840102 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.840071 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:40:30.972864 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.972827 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:40:30.975084 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.975062 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:30.996961 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:30.996933 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:40:31.071889 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.071811 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.071889 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.071849 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxgw\" (UniqueName: \"kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.071889 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.071871 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.072081 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.071914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.072081 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.071996 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.072081 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.072025 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.072081 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.072045 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172645 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172688 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172711 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172742 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172756 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxgw\" (UniqueName: \"kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.172791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.173080 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.172807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.173476 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.173446 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.173583 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.173564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.173648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.173564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.173717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.173695 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.175170 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.175139 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.175326 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.175295 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.185349 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.185330 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxgw\" (UniqueName: \"kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw\") pod \"console-6bcc76559d-5pf8k\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.285662 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.285637 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:31.355810 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.355774 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:31.458892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.458865 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:40:31.462800 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:40:31.462772 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b11da8_58c5_47c5_a227_171c62720a98.slice/crio-8d055f10bc4cea75c4232185cb52dfcb46a1845ee4a8bedef166c7e80bfd7158 WatchSource:0}: Error finding container 8d055f10bc4cea75c4232185cb52dfcb46a1845ee4a8bedef166c7e80bfd7158: Status 404 returned error can't find the container with id 8d055f10bc4cea75c4232185cb52dfcb46a1845ee4a8bedef166c7e80bfd7158 Jul 02 11:40:31.489803 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.489779 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:31.774548 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.774513 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc76559d-5pf8k" event={"ID":"96b11da8-58c5-47c5-a227-171c62720a98","Type":"ContainerStarted","Data":"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b"} Jul 02 11:40:31.774693 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.774565 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc76559d-5pf8k" event={"ID":"96b11da8-58c5-47c5-a227-171c62720a98","Type":"ContainerStarted","Data":"8d055f10bc4cea75c4232185cb52dfcb46a1845ee4a8bedef166c7e80bfd7158"} Jul 02 11:40:31.795880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:31.795833 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bcc76559d-5pf8k" podStartSLOduration=1.795818643 podStartE2EDuration="1.795818643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:40:31.794111112 +0000 UTC m=+195.488146236" watchObservedRunningTime="2026-07-02 11:40:31.795818643 +0000 UTC m=+195.489853767" Jul 02 11:40:32.238854 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:32.238770 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:32.340651 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:32.340610 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:37.360046 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:37.360010 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:37.528565 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:37.528532 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:41.286346 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.286314 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:41.286793 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.286373 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:41.290773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.290753 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:41.815546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.815520 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:40:41.871027 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.870996 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:40:41.986007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:41.985977 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:42.087769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:42.087672 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:42.152428 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:42.152399 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:44.263299 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:44.263239 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:44.360649 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:44.360612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:47.120185 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:47.120152 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:40:55.860481 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:55.860421 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f88c5bc7c-vbnbp" podUID="e2271db0-8066-4585-9f10-e78948378910" containerName="console" containerID="cri-o://34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff" gracePeriod=15 Jul 02 11:40:56.096634 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.096606 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:40:56.152642 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152583 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5b69\" (UniqueName: \"kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152648 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152674 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152715 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152887 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152762 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152887 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152823 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.152887 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.152849 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca\") pod \"e2271db0-8066-4585-9f10-e78948378910\" (UID: \"e2271db0-8066-4585-9f10-e78948378910\") " Jul 02 11:40:56.153184 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.153157 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config" (OuterVolumeSpecName: "console-config") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:40:56.153360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.153327 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:40:56.153360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.153308 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:40:56.153542 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.153373 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:40:56.154771 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.154748 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:40:56.154855 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.154778 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:40:56.154895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.154862 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69" (OuterVolumeSpecName: "kube-api-access-v5b69") pod "e2271db0-8066-4585-9f10-e78948378910" (UID: "e2271db0-8066-4585-9f10-e78948378910"). InnerVolumeSpecName "kube-api-access-v5b69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:40:56.253596 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253567 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253596 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253591 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253604 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253617 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5b69\" (UniqueName: \"kubernetes.io/projected/e2271db0-8066-4585-9f10-e78948378910-kube-api-access-v5b69\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253629 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2271db0-8066-4585-9f10-e78948378910-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253653 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.253742 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.253668 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2271db0-8066-4585-9f10-e78948378910-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:40:56.867416 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.867388 2551 generic.go:356] "Generic (PLEG): container finished" podID="e2271db0-8066-4585-9f10-e78948378910" containerID="34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff" exitCode=0 Jul 02 11:40:56.867840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.867453 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f88c5bc7c-vbnbp" Jul 02 11:40:56.867840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.867467 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f88c5bc7c-vbnbp" event={"ID":"e2271db0-8066-4585-9f10-e78948378910","Type":"ContainerDied","Data":"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff"} Jul 02 11:40:56.867840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.867520 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f88c5bc7c-vbnbp" event={"ID":"e2271db0-8066-4585-9f10-e78948378910","Type":"ContainerDied","Data":"c2f6ac91315016c712894fd25644039d5e5b261908118e409e1ed4e04b1ac697"} Jul 02 11:40:56.867840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.867540 2551 scope.go:117] "RemoveContainer" containerID="34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff" Jul 02 11:40:56.877350 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.877326 2551 scope.go:117] "RemoveContainer" containerID="34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff" Jul 02 11:40:56.877621 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:40:56.877603 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff\": container with ID starting with 34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff not found: ID does not exist" containerID="34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff" Jul 02 11:40:56.877691 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.877627 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff"} err="failed to get container status \"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff\": rpc error: code = NotFound desc = could not find container \"34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff\": container with ID starting with 34ae024ee12952f2abb0dc68ce457be49032780f40f2e21a41418836a95264ff not found: ID does not exist" Jul 02 11:40:56.886589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.886569 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:40:56.890380 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:56.890361 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f88c5bc7c-vbnbp"] Jul 02 11:40:58.816607 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:40:58.816575 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2271db0-8066-4585-9f10-e78948378910" path="/var/lib/kubelet/pods/e2271db0-8066-4585-9f10-e78948378910/volumes" Jul 02 11:41:06.877563 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:06.877532 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:41:06.898719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:06.898687 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-788cf7d958-7lzhd" podUID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" containerName="console" containerID="cri-o://ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471" gracePeriod=15 Jul 02 11:41:07.136451 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.136397 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:41:07.237945 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.237915 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.237951 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.237991 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljfbm\" (UniqueName: \"kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238028 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238060 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238080 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238370 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238106 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert\") pod \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\" (UID: \"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0\") " Jul 02 11:41:07.238370 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238338 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:41:07.238558 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238532 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:41:07.238636 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238601 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config" (OuterVolumeSpecName: "console-config") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:41:07.238786 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.238751 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:41:07.240428 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.240400 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:41:07.240428 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.240417 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm" (OuterVolumeSpecName: "kube-api-access-ljfbm") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "kube-api-access-ljfbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:41:07.240546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.240437 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" (UID: "e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:41:07.339092 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339069 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339092 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339090 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339099 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339109 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339117 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339125 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljfbm\" (UniqueName: \"kubernetes.io/projected/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-kube-api-access-ljfbm\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.339224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.339133 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:07.909444 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.909408 2551 generic.go:356] "Generic (PLEG): container finished" podID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" containerID="ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471" exitCode=0 Jul 02 11:41:07.909867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.909469 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788cf7d958-7lzhd" Jul 02 11:41:07.909867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.909473 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788cf7d958-7lzhd" event={"ID":"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0","Type":"ContainerDied","Data":"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471"} Jul 02 11:41:07.909867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.909520 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788cf7d958-7lzhd" event={"ID":"e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0","Type":"ContainerDied","Data":"33f3a8172569b6d257b8ba956258c4ad310e7258bb6aa9192185a16140e64dfb"} Jul 02 11:41:07.909867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.909540 2551 scope.go:117] "RemoveContainer" containerID="ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471" Jul 02 11:41:07.917980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.917962 2551 scope.go:117] "RemoveContainer" containerID="ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471" Jul 02 11:41:07.918224 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:41:07.918207 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471\": container with ID starting with ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471 not found: ID does not exist" containerID="ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471" Jul 02 11:41:07.918288 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.918233 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471"} err="failed to get container status \"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471\": rpc error: code = NotFound desc = could not find container \"ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471\": container with ID starting with ec594e549c266506ff5810b9d29c232b99f716a1f6e41ee6800ff455dc80c471 not found: ID does not exist" Jul 02 11:41:07.930942 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.930918 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:41:07.936772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:07.936750 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-788cf7d958-7lzhd"] Jul 02 11:41:08.816644 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:08.816610 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" path="/var/lib/kubelet/pods/e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0/volumes" Jul 02 11:41:35.019016 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:35.018972 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:41:35.215272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:35.215220 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:41:36.017007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.016974 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84"] Jul 02 11:41:36.017351 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017335 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" containerName="console" Jul 02 11:41:36.017446 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017353 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" containerName="console" Jul 02 11:41:36.017446 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017373 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2271db0-8066-4585-9f10-e78948378910" containerName="console" Jul 02 11:41:36.017446 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017380 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2271db0-8066-4585-9f10-e78948378910" containerName="console" Jul 02 11:41:36.017600 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017458 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2271db0-8066-4585-9f10-e78948378910" containerName="console" Jul 02 11:41:36.017600 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.017474 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="e203a9f9-fb8b-4f9e-bfd3-64505c0a50c0" containerName="console" Jul 02 11:41:36.020215 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.020194 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.023002 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.022984 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 11:41:36.023286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.023269 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 11:41:36.024014 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.023998 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qn5ht\"" Jul 02 11:41:36.030602 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.030583 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84"] Jul 02 11:41:36.145390 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.145353 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qdjj\" (UniqueName: \"kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.145548 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.145401 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.145548 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.145489 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.246065 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.246035 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.246186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.246080 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qdjj\" (UniqueName: \"kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.246186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.246116 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.246522 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.246503 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.246568 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.246519 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.259402 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.259377 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qdjj\" (UniqueName: \"kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.329205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.329186 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:36.458383 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:36.458331 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84"] Jul 02 11:41:36.461143 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:41:36.461113 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2290a00a_aed4_423d_99f6_8225cd4f5753.slice/crio-61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10 WatchSource:0}: Error finding container 61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10: Status 404 returned error can't find the container with id 61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10 Jul 02 11:41:37.012986 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:37.012952 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerStarted","Data":"61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10"} Jul 02 11:41:43.037837 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:43.037798 2551 generic.go:356] "Generic (PLEG): container finished" podID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerID="127775fd4058ef1fc339b1fa3074de32f12a8cbb1f4858c53a5e444b646d750b" exitCode=0 Jul 02 11:41:43.038210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:43.037883 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerDied","Data":"127775fd4058ef1fc339b1fa3074de32f12a8cbb1f4858c53a5e444b646d750b"} Jul 02 11:41:45.049980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:45.049949 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerStarted","Data":"7f5b5e0f7663e5cdbe48b0ae1f6851cf3990bafa760bba969863055a1830cdec"} Jul 02 11:41:46.060482 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:46.060450 2551 generic.go:356] "Generic (PLEG): container finished" podID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerID="7f5b5e0f7663e5cdbe48b0ae1f6851cf3990bafa760bba969863055a1830cdec" exitCode=0 Jul 02 11:41:46.060848 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:46.060525 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerDied","Data":"7f5b5e0f7663e5cdbe48b0ae1f6851cf3990bafa760bba969863055a1830cdec"} Jul 02 11:41:54.097992 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:54.097954 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerStarted","Data":"dc615fae6fd1f9276b63d356c00885447d8c12ea5335e19c4508105e08fc137a"} Jul 02 11:41:54.121364 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:54.121310 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" podStartSLOduration=3.413535533 podStartE2EDuration="19.121294569s" totalImagesPullingTime="15.707759036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:41:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:41:54.119244039 +0000 UTC m=+277.813279164" watchObservedRunningTime="2026-07-02 11:41:54.121294569 +0000 UTC m=+277.815329697" Jul 02 11:41:55.103933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:55.103895 2551 generic.go:356] "Generic (PLEG): container finished" podID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerID="dc615fae6fd1f9276b63d356c00885447d8c12ea5335e19c4508105e08fc137a" exitCode=0 Jul 02 11:41:55.104399 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:55.103970 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerDied","Data":"dc615fae6fd1f9276b63d356c00885447d8c12ea5335e19c4508105e08fc137a"} Jul 02 11:41:56.269375 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.269352 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:41:56.305088 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.305056 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle\") pod \"2290a00a-aed4-423d-99f6-8225cd4f5753\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " Jul 02 11:41:56.305242 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.305147 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qdjj\" (UniqueName: \"kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj\") pod \"2290a00a-aed4-423d-99f6-8225cd4f5753\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " Jul 02 11:41:56.305242 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.305207 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util\") pod \"2290a00a-aed4-423d-99f6-8225cd4f5753\" (UID: \"2290a00a-aed4-423d-99f6-8225cd4f5753\") " Jul 02 11:41:56.305815 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.305784 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle" (OuterVolumeSpecName: "bundle") pod "2290a00a-aed4-423d-99f6-8225cd4f5753" (UID: "2290a00a-aed4-423d-99f6-8225cd4f5753"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:41:56.307408 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.307381 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj" (OuterVolumeSpecName: "kube-api-access-7qdjj") pod "2290a00a-aed4-423d-99f6-8225cd4f5753" (UID: "2290a00a-aed4-423d-99f6-8225cd4f5753"). InnerVolumeSpecName "kube-api-access-7qdjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:41:56.309982 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.309960 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util" (OuterVolumeSpecName: "util") pod "2290a00a-aed4-423d-99f6-8225cd4f5753" (UID: "2290a00a-aed4-423d-99f6-8225cd4f5753"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:41:56.406527 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.406496 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qdjj\" (UniqueName: \"kubernetes.io/projected/2290a00a-aed4-423d-99f6-8225cd4f5753-kube-api-access-7qdjj\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:56.406527 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.406520 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:56.406527 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:56.406530 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2290a00a-aed4-423d-99f6-8225cd4f5753-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:41:57.112435 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:57.112359 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" event={"ID":"2290a00a-aed4-423d-99f6-8225cd4f5753","Type":"ContainerDied","Data":"61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10"} Jul 02 11:41:57.112435 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:57.112414 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61af36614d9d22d4c7f23a606792cbc18f1346eb470660911ccf451e779f7e10" Jul 02 11:41:57.112435 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:41:57.112378 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dzsk84" Jul 02 11:42:02.159475 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:02.159441 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:02.951587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:02.951553 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:04.352858 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.352826 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m"] Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353083 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="pull" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353093 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="pull" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353112 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="extract" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353118 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="extract" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353126 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="util" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353133 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="util" Jul 02 11:42:04.353221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.353184 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="2290a00a-aed4-423d-99f6-8225cd4f5753" containerName="extract" Jul 02 11:42:04.355098 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.355082 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.359287 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.359266 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 11:42:04.359415 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.359313 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:42:04.362007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.361981 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-76zkt\"" Jul 02 11:42:04.382853 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.382824 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m"] Jul 02 11:42:04.461568 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.461537 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2zmp\" (UniqueName: \"kubernetes.io/projected/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-kube-api-access-c2zmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.461683 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.461597 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.562907 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.562879 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.563007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.562931 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2zmp\" (UniqueName: \"kubernetes.io/projected/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-kube-api-access-c2zmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.563238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.563221 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.578846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.578820 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2zmp\" (UniqueName: \"kubernetes.io/projected/bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28-kube-api-access-c2zmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-ns69m\" (UID: \"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.663995 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.663921 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" Jul 02 11:42:04.792295 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:04.792269 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m"] Jul 02 11:42:04.795951 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:04.795920 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc61ca58_c8d7_4c33_8cb9_ac6aa87f6c28.slice/crio-fa1fb093f99ba774a3179eb952bcb58c93182812f56a7277eb46c570fded63a6 WatchSource:0}: Error finding container fa1fb093f99ba774a3179eb952bcb58c93182812f56a7277eb46c570fded63a6: Status 404 returned error can't find the container with id fa1fb093f99ba774a3179eb952bcb58c93182812f56a7277eb46c570fded63a6 Jul 02 11:42:05.142169 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:05.142135 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" event={"ID":"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28","Type":"ContainerStarted","Data":"fa1fb093f99ba774a3179eb952bcb58c93182812f56a7277eb46c570fded63a6"} Jul 02 11:42:05.900820 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:05.900771 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:06.000138 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:06.000102 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:07.153525 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.153492 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" event={"ID":"bc61ca58-c8d7-4c33-8cb9-ac6aa87f6c28","Type":"ContainerStarted","Data":"52b97401a9dd9c03d9b37d816d02c585d028197b6b2e27cda549b8c332b2f019"} Jul 02 11:42:07.165096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.165060 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:07.179599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.179556 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-ns69m" podStartSLOduration=1.723430605 podStartE2EDuration="3.179541564s" totalImagesPullingTime="1.456110959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:42:07.177762902 +0000 UTC m=+290.871798032" watchObservedRunningTime="2026-07-02 11:42:07.179541564 +0000 UTC m=+290.873576688" Jul 02 11:42:07.264843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.264810 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:07.611068 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.611010 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:07.766044 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:07.766006 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:08.186977 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.186946 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn"] Jul 02 11:42:08.189338 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.189321 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.192000 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.191979 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 11:42:08.192870 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.192839 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 11:42:08.192971 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.192872 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qn5ht\"" Jul 02 11:42:08.199439 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.199418 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn"] Jul 02 11:42:08.291986 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.291957 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.292130 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.291995 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25tx\" (UniqueName: \"kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.292130 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.292088 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.393041 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.393009 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.393186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.393074 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.393186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.393103 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25tx\" (UniqueName: \"kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.393472 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.393437 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.393527 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.393449 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.404993 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.404960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25tx\" (UniqueName: \"kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.498117 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.498045 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:08.632821 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:08.632791 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn"] Jul 02 11:42:08.633325 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:08.633298 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5facde4d_9359_4143_93e9_243c17fae55e.slice/crio-585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146 WatchSource:0}: Error finding container 585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146: Status 404 returned error can't find the container with id 585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146 Jul 02 11:42:09.163854 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:09.163819 2551 generic.go:356] "Generic (PLEG): container finished" podID="5facde4d-9359-4143-93e9-243c17fae55e" containerID="a021e0ab992f0c03201396b10b08f3b511a82bf43dca1f5363e25ad518d837ac" exitCode=0 Jul 02 11:42:09.164025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:09.163871 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" event={"ID":"5facde4d-9359-4143-93e9-243c17fae55e","Type":"ContainerDied","Data":"a021e0ab992f0c03201396b10b08f3b511a82bf43dca1f5363e25ad518d837ac"} Jul 02 11:42:09.164025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:09.163906 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" event={"ID":"5facde4d-9359-4143-93e9-243c17fae55e","Type":"ContainerStarted","Data":"585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146"} Jul 02 11:42:10.439123 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.439081 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:10.504758 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.504729 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt"] Jul 02 11:42:10.507411 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.507388 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.509889 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.509863 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nbx6m\"" Jul 02 11:42:10.510041 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.509860 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 11:42:10.510808 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.510789 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 11:42:10.519785 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.519757 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt"] Jul 02 11:42:10.611080 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.611051 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn9tg\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-kube-api-access-nn9tg\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.611220 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.611084 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.711880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.711798 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn9tg\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-kube-api-access-nn9tg\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.711880 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.711847 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.721916 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.721895 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.727357 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.727331 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn9tg\" (UniqueName: \"kubernetes.io/projected/f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f-kube-api-access-nn9tg\") pod \"cert-manager-cainjector-5d99449ffd-cp6bt\" (UID: \"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.817323 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.817296 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" Jul 02 11:42:10.965083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:10.965007 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt"] Jul 02 11:42:11.002978 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:11.002947 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:11.548661 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:11.548622 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf98764fa_2f2a_4c31_9a5b_793cdd2f4c2f.slice/crio-59b8ffb7ac40d0ddfb3c0927b5771a7c0d35a1d8f5f60c18cbfca97fac7aa46c WatchSource:0}: Error finding container 59b8ffb7ac40d0ddfb3c0927b5771a7c0d35a1d8f5f60c18cbfca97fac7aa46c: Status 404 returned error can't find the container with id 59b8ffb7ac40d0ddfb3c0927b5771a7c0d35a1d8f5f60c18cbfca97fac7aa46c Jul 02 11:42:12.179353 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:12.179317 2551 generic.go:356] "Generic (PLEG): container finished" podID="5facde4d-9359-4143-93e9-243c17fae55e" containerID="b5228c969a3a4b9589ecd5c9204787bf7279df6e97a9e4619532c93dc0264d86" exitCode=0 Jul 02 11:42:12.179543 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:12.179414 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" event={"ID":"5facde4d-9359-4143-93e9-243c17fae55e","Type":"ContainerDied","Data":"b5228c969a3a4b9589ecd5c9204787bf7279df6e97a9e4619532c93dc0264d86"} Jul 02 11:42:12.180926 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:12.180892 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" event={"ID":"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f","Type":"ContainerStarted","Data":"59b8ffb7ac40d0ddfb3c0927b5771a7c0d35a1d8f5f60c18cbfca97fac7aa46c"} Jul 02 11:42:13.189201 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:13.189165 2551 generic.go:356] "Generic (PLEG): container finished" podID="5facde4d-9359-4143-93e9-243c17fae55e" containerID="3bc6b8e15c775129a5a2f0fb019fbf10cd36532dbd0ac16a4cc1657b98782e5c" exitCode=0 Jul 02 11:42:13.189605 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:13.189222 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" event={"ID":"5facde4d-9359-4143-93e9-243c17fae55e","Type":"ContainerDied","Data":"3bc6b8e15c775129a5a2f0fb019fbf10cd36532dbd0ac16a4cc1657b98782e5c"} Jul 02 11:42:14.195443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.195403 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" event={"ID":"f98764fa-2f2a-4c31-9a5b-793cdd2f4c2f","Type":"ContainerStarted","Data":"d5bf08ea4e43dea3adea5400fa05bae472f48053d49e2bcc05a25d2e9d24e728"} Jul 02 11:42:14.233683 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.233628 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-cp6bt" podStartSLOduration=2.066622042 podStartE2EDuration="4.233611594s" totalImagesPullingTime="2.166989552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:42:14.230237644 +0000 UTC m=+297.924272770" watchObservedRunningTime="2026-07-02 11:42:14.233611594 +0000 UTC m=+297.927646720" Jul 02 11:42:14.321969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.321942 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:14.444727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.444699 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util\") pod \"5facde4d-9359-4143-93e9-243c17fae55e\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " Jul 02 11:42:14.444899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.444739 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle\") pod \"5facde4d-9359-4143-93e9-243c17fae55e\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " Jul 02 11:42:14.444899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.444758 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25tx\" (UniqueName: \"kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx\") pod \"5facde4d-9359-4143-93e9-243c17fae55e\" (UID: \"5facde4d-9359-4143-93e9-243c17fae55e\") " Jul 02 11:42:14.445060 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.445038 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle" (OuterVolumeSpecName: "bundle") pod "5facde4d-9359-4143-93e9-243c17fae55e" (UID: "5facde4d-9359-4143-93e9-243c17fae55e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:42:14.446884 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.446825 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx" (OuterVolumeSpecName: "kube-api-access-b25tx") pod "5facde4d-9359-4143-93e9-243c17fae55e" (UID: "5facde4d-9359-4143-93e9-243c17fae55e"). InnerVolumeSpecName "kube-api-access-b25tx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:42:14.449400 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.449370 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util" (OuterVolumeSpecName: "util") pod "5facde4d-9359-4143-93e9-243c17fae55e" (UID: "5facde4d-9359-4143-93e9-243c17fae55e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:42:14.545395 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.545363 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:14.545395 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.545387 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5facde4d-9359-4143-93e9-243c17fae55e-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:14.545395 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:14.545398 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25tx\" (UniqueName: \"kubernetes.io/projected/5facde4d-9359-4143-93e9-243c17fae55e-kube-api-access-b25tx\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:15.202053 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:15.201979 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" Jul 02 11:42:15.202053 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:15.202014 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffhghn" event={"ID":"5facde4d-9359-4143-93e9-243c17fae55e","Type":"ContainerDied","Data":"585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146"} Jul 02 11:42:15.202453 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:15.202057 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="585298fd0e720d3b775db5ad465cafc50087e3727b7415758d6b58a815a8a146" Jul 02 11:42:16.276691 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.276653 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:16.397311 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.397278 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:16.742447 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.742378 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:42:16.743708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.743678 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:42:16.747785 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.747760 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:42:16.749313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.749291 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:42:16.753917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:16.753899 2551 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 11:42:19.129680 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:19.129647 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:21.042611 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:21.042572 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:27.107239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:27.107170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:27.204040 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:27.203995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:28.364568 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364536 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5j774"] Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364812 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="extract" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364823 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="extract" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364842 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="pull" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364848 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="pull" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364862 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="util" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364867 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="util" Jul 02 11:42:28.364933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.364928 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="5facde4d-9359-4143-93e9-243c17fae55e" containerName="extract" Jul 02 11:42:28.413675 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.413649 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5j774"] Jul 02 11:42:28.413817 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.413736 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.416481 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.416456 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rw6xg\"" Jul 02 11:42:28.544028 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.544002 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spdl\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-kube-api-access-5spdl\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.544151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.544098 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-bound-sa-token\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.644997 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.644920 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-bound-sa-token\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.644997 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.644974 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spdl\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-kube-api-access-5spdl\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.653355 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.653323 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-bound-sa-token\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.653524 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.653505 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spdl\" (UniqueName: \"kubernetes.io/projected/298a8fa6-6731-4b9e-86d4-23174e848b5b-kube-api-access-5spdl\") pod \"cert-manager-59c77684cc-5j774\" (UID: \"298a8fa6-6731-4b9e-86d4-23174e848b5b\") " pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.688532 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.688503 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9"] Jul 02 11:42:28.703013 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.702993 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9"] Jul 02 11:42:28.703116 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.703082 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.706058 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.706033 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 11:42:28.706386 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.706368 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qn5ht\"" Jul 02 11:42:28.707167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.707148 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 11:42:28.722766 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.722744 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5j774" Jul 02 11:42:28.845689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.845659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.845844 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.845705 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svgs\" (UniqueName: \"kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.845844 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.845730 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.872774 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.872752 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5j774"] Jul 02 11:42:28.874782 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:28.874758 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod298a8fa6_6731_4b9e_86d4_23174e848b5b.slice/crio-f17a03bddd4aef44407c3c5711588f6abe01af7d8522b0049cb1db6c24bd9e0e WatchSource:0}: Error finding container f17a03bddd4aef44407c3c5711588f6abe01af7d8522b0049cb1db6c24bd9e0e: Status 404 returned error can't find the container with id f17a03bddd4aef44407c3c5711588f6abe01af7d8522b0049cb1db6c24bd9e0e Jul 02 11:42:28.946870 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.946846 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.946959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.946887 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svgs\" (UniqueName: \"kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.946959 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.946921 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.947333 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.947311 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.947373 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.947327 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.958382 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.958359 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svgs\" (UniqueName: \"kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:28.974566 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:28.974541 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:29.012739 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.012716 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:29.171169 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.171147 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9"] Jul 02 11:42:29.172625 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:29.172599 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode232c07e_e9c2_4d99_939d_57c4c383d75c.slice/crio-d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6 WatchSource:0}: Error finding container d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6: Status 404 returned error can't find the container with id d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6 Jul 02 11:42:29.263599 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.263564 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5j774" event={"ID":"298a8fa6-6731-4b9e-86d4-23174e848b5b","Type":"ContainerStarted","Data":"3ff45113d92db901e9349acacd9cf48a96c088c36a61daa986b79b8ca47be98c"} Jul 02 11:42:29.263733 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.263615 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5j774" event={"ID":"298a8fa6-6731-4b9e-86d4-23174e848b5b","Type":"ContainerStarted","Data":"f17a03bddd4aef44407c3c5711588f6abe01af7d8522b0049cb1db6c24bd9e0e"} Jul 02 11:42:29.265366 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.265343 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerStarted","Data":"d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6"} Jul 02 11:42:29.288470 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:29.288427 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5j774" podStartSLOduration=1.288413411 podStartE2EDuration="1.288413411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:42:29.286754445 +0000 UTC m=+312.980789570" watchObservedRunningTime="2026-07-02 11:42:29.288413411 +0000 UTC m=+312.982448536" Jul 02 11:42:30.271621 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:30.271588 2551 generic.go:356] "Generic (PLEG): container finished" podID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerID="c8973cfcc4c9523f6b0232526f388a600d9e2bdc6e1b96459c85e36a91ff8109" exitCode=0 Jul 02 11:42:30.271984 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:30.271672 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerDied","Data":"c8973cfcc4c9523f6b0232526f388a600d9e2bdc6e1b96459c85e36a91ff8109"} Jul 02 11:42:30.272083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:30.272067 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 11:42:31.279425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:31.279401 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerStarted","Data":"33196744816e420b78cde8ce8f7d46e7dd0772d05fbefbf87074b59321393ac2"} Jul 02 11:42:32.285582 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:32.285550 2551 generic.go:356] "Generic (PLEG): container finished" podID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerID="33196744816e420b78cde8ce8f7d46e7dd0772d05fbefbf87074b59321393ac2" exitCode=0 Jul 02 11:42:32.285994 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:32.285631 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerDied","Data":"33196744816e420b78cde8ce8f7d46e7dd0772d05fbefbf87074b59321393ac2"} Jul 02 11:42:33.291846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:33.291807 2551 generic.go:356] "Generic (PLEG): container finished" podID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerID="4487762ceb5e8300d72e45b7aab549aa7d0f04545b4478d20ccaede6d4334ed4" exitCode=0 Jul 02 11:42:33.292280 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:33.291901 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerDied","Data":"4487762ceb5e8300d72e45b7aab549aa7d0f04545b4478d20ccaede6d4334ed4"} Jul 02 11:42:34.426840 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.426816 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:34.588180 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.588096 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2svgs\" (UniqueName: \"kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs\") pod \"e232c07e-e9c2-4d99-939d-57c4c383d75c\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " Jul 02 11:42:34.588180 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.588135 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle\") pod \"e232c07e-e9c2-4d99-939d-57c4c383d75c\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " Jul 02 11:42:34.588454 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.588195 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util\") pod \"e232c07e-e9c2-4d99-939d-57c4c383d75c\" (UID: \"e232c07e-e9c2-4d99-939d-57c4c383d75c\") " Jul 02 11:42:34.588935 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.588906 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle" (OuterVolumeSpecName: "bundle") pod "e232c07e-e9c2-4d99-939d-57c4c383d75c" (UID: "e232c07e-e9c2-4d99-939d-57c4c383d75c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:42:34.590154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.590133 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs" (OuterVolumeSpecName: "kube-api-access-2svgs") pod "e232c07e-e9c2-4d99-939d-57c4c383d75c" (UID: "e232c07e-e9c2-4d99-939d-57c4c383d75c"). InnerVolumeSpecName "kube-api-access-2svgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:42:34.594863 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.594839 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util" (OuterVolumeSpecName: "util") pod "e232c07e-e9c2-4d99-939d-57c4c383d75c" (UID: "e232c07e-e9c2-4d99-939d-57c4c383d75c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:42:34.689114 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.689087 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2svgs\" (UniqueName: \"kubernetes.io/projected/e232c07e-e9c2-4d99-939d-57c4c383d75c-kube-api-access-2svgs\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:34.689114 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.689112 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:34.689242 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:34.689120 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e232c07e-e9c2-4d99-939d-57c4c383d75c-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:42:35.302823 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:35.302785 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" event={"ID":"e232c07e-e9c2-4d99-939d-57c4c383d75c","Type":"ContainerDied","Data":"d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6"} Jul 02 11:42:35.302991 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:35.302832 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6744ab36e40b4cdc72fc75d6be79df998d30640c87da2d321af2435963af9d6" Jul 02 11:42:35.302991 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:35.302852 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af658v9" Jul 02 11:42:43.454494 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:43.454459 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:45.591489 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:45.591453 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:45.700083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:45.700051 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:46.408099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.408059 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:46.677574 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.677489 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:46.791701 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.791671 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:46.829953 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.829927 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5"] Jul 02 11:42:46.830197 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830186 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="util" Jul 02 11:42:46.830238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830198 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="util" Jul 02 11:42:46.830238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830205 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="extract" Jul 02 11:42:46.830238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830211 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="extract" Jul 02 11:42:46.830238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830223 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="pull" Jul 02 11:42:46.830238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830229 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="pull" Jul 02 11:42:46.830411 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.830298 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="e232c07e-e9c2-4d99-939d-57c4c383d75c" containerName="extract" Jul 02 11:42:46.832352 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.832332 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:46.837572 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.837409 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 11:42:46.837572 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.837441 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gw54k\"" Jul 02 11:42:46.837572 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.837525 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 11:42:46.837795 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.837577 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 11:42:46.837795 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.837697 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 11:42:46.857278 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.857240 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5"] Jul 02 11:42:46.975911 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.975840 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:46.975911 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.975882 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-manifests\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:46.975911 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.975905 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-tmp\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:46.976099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.975943 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:46.976099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:46.976003 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f842\" (UniqueName: \"kubernetes.io/projected/b136a8c9-413a-42c6-a521-a7208852046e-kube-api-access-4f842\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.007606 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.007577 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:47.077186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077161 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.077313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077203 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-manifests\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.077313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077223 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-tmp\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.077313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077269 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.077313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077306 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f842\" (UniqueName: \"kubernetes.io/projected/b136a8c9-413a-42c6-a521-a7208852046e-kube-api-access-4f842\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.077670 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.077650 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-manifests\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.079497 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.079478 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b136a8c9-413a-42c6-a521-a7208852046e-tmp\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.079715 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.079699 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.079771 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.079698 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b136a8c9-413a-42c6-a521-a7208852046e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.118126 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.118104 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f842\" (UniqueName: \"kubernetes.io/projected/b136a8c9-413a-42c6-a521-a7208852046e-kube-api-access-4f842\") pod \"opendatahub-operator-controller-manager-588c456b6-8d8h5\" (UID: \"b136a8c9-413a-42c6-a521-a7208852046e\") " pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.142205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.142184 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:47.178056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.178024 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:47.320719 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:42:47.320682 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb136a8c9_413a_42c6_a521_a7208852046e.slice/crio-8c2d461f1bf884835a1f5a33aa546d028cfba8b127a149c861c5cc1664cd4a7b WatchSource:0}: Error finding container 8c2d461f1bf884835a1f5a33aa546d028cfba8b127a149c861c5cc1664cd4a7b: Status 404 returned error can't find the container with id 8c2d461f1bf884835a1f5a33aa546d028cfba8b127a149c861c5cc1664cd4a7b Jul 02 11:42:47.321609 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.321588 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5"] Jul 02 11:42:47.331512 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.331483 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:47.355297 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.355272 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" event={"ID":"b136a8c9-413a-42c6-a521-a7208852046e","Type":"ContainerStarted","Data":"8c2d461f1bf884835a1f5a33aa546d028cfba8b127a149c861c5cc1664cd4a7b"} Jul 02 11:42:47.490074 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.490039 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:47.630812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:47.630729 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:51.379769 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:51.379733 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" event={"ID":"b136a8c9-413a-42c6-a521-a7208852046e","Type":"ContainerStarted","Data":"479b481e2a7f8227b187be8b380449a180c6dd7368c6610de3036b8e38fa6ea8"} Jul 02 11:42:52.385145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:52.385113 2551 generic.go:356] "Generic (PLEG): container finished" podID="b136a8c9-413a-42c6-a521-a7208852046e" containerID="479b481e2a7f8227b187be8b380449a180c6dd7368c6610de3036b8e38fa6ea8" exitCode=0 Jul 02 11:42:52.385542 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:52.385198 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" event={"ID":"b136a8c9-413a-42c6-a521-a7208852046e","Type":"ContainerDied","Data":"479b481e2a7f8227b187be8b380449a180c6dd7368c6610de3036b8e38fa6ea8"} Jul 02 11:42:53.391740 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:53.391696 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" event={"ID":"b136a8c9-413a-42c6-a521-a7208852046e","Type":"ContainerStarted","Data":"3f52b3181ef938ad1fb1301c492e520260e58d589563457848c14f0fc6c1b4b8"} Jul 02 11:42:53.392142 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:53.391835 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:42:53.414350 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:53.414325 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:53.425876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:53.425834 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" podStartSLOduration=2.997292189 podStartE2EDuration="7.425817035s" totalImagesPullingTime="3.416421529s" totalInitContainerRuntime="1.012103317s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:42:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:42:53.424545457 +0000 UTC m=+337.118580582" watchObservedRunningTime="2026-07-02 11:42:53.425817035 +0000 UTC m=+337.119852162" Jul 02 11:42:53.519184 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:53.519136 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:54.515925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:54.515890 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:54.641013 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:54.640983 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:58.467360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:58.467324 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:42:58.588457 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:42:58.588427 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:04.397631 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:04.397602 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-588c456b6-8d8h5" Jul 02 11:43:06.225867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:06.225833 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:06.473268 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:06.473209 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:06.962135 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:06.962098 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:07.185544 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.185509 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc"] Jul 02 11:43:07.195354 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.195332 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.199941 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.199921 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 11:43:07.204882 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.204866 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 11:43:07.205976 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.205962 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lqwqw\"" Jul 02 11:43:07.239327 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.239282 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d64f9e23-37d4-42cc-a49f-f870b17876da-tls-certs\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.239327 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.239324 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64f9e23-37d4-42cc-a49f-f870b17876da-tmp\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.239617 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.239344 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6dz\" (UniqueName: \"kubernetes.io/projected/d64f9e23-37d4-42cc-a49f-f870b17876da-kube-api-access-cr6dz\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.269120 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.269096 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc"] Jul 02 11:43:07.340443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.340419 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d64f9e23-37d4-42cc-a49f-f870b17876da-tls-certs\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.340544 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.340468 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64f9e23-37d4-42cc-a49f-f870b17876da-tmp\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.340544 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.340488 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6dz\" (UniqueName: \"kubernetes.io/projected/d64f9e23-37d4-42cc-a49f-f870b17876da-kube-api-access-cr6dz\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.342711 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.342683 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64f9e23-37d4-42cc-a49f-f870b17876da-tmp\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.342868 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.342851 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d64f9e23-37d4-42cc-a49f-f870b17876da-tls-certs\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.350265 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.350222 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6dz\" (UniqueName: \"kubernetes.io/projected/d64f9e23-37d4-42cc-a49f-f870b17876da-kube-api-access-cr6dz\") pod \"kube-auth-proxy-6f5f497c84-9lgnc\" (UID: \"d64f9e23-37d4-42cc-a49f-f870b17876da\") " pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.375563 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.375542 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:07.504361 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.504310 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" Jul 02 11:43:07.642288 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.642212 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:07.643571 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.643548 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc"] Jul 02 11:43:07.646493 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:43:07.646470 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64f9e23_37d4_42cc_a49f_f870b17876da.slice/crio-f7c1320749d4180a0d395f79acede4908d9ae496e2f781acace6877f0f55db10 WatchSource:0}: Error finding container f7c1320749d4180a0d395f79acede4908d9ae496e2f781acace6877f0f55db10: Status 404 returned error can't find the container with id f7c1320749d4180a0d395f79acede4908d9ae496e2f781acace6877f0f55db10 Jul 02 11:43:07.755792 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.755702 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:07.858554 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:07.858521 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:08.086391 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:08.086355 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:08.222612 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:08.222578 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:08.457877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:08.457801 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" event={"ID":"d64f9e23-37d4-42cc-a49f-f870b17876da","Type":"ContainerStarted","Data":"f7c1320749d4180a0d395f79acede4908d9ae496e2f781acace6877f0f55db10"} Jul 02 11:43:09.086045 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:09.086006 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:09.217550 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:09.217454 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:09.487353 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:09.487274 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:10.204810 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:10.204764 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:10.650892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:10.650859 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:11.474867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:11.474838 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" event={"ID":"d64f9e23-37d4-42cc-a49f-f870b17876da","Type":"ContainerStarted","Data":"4d7dec9cc179e0a9d4b018c50f1cac3e7671453c147501aef72a4403f76e497a"} Jul 02 11:43:11.497269 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:11.497215 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f5f497c84-9lgnc" podStartSLOduration=1.188347062 podStartE2EDuration="4.497200599s" totalImagesPullingTime="3.308853537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:43:11.49634803 +0000 UTC m=+355.190383156" watchObservedRunningTime="2026-07-02 11:43:11.497200599 +0000 UTC m=+355.191235724" Jul 02 11:43:14.250281 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.250231 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:14.424206 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.424170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:14.601324 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.601295 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8"] Jul 02 11:43:14.604581 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.604565 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.607975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.607950 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 11:43:14.608288 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.608270 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xv7vc\"" Jul 02 11:43:14.628864 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.628839 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8"] Jul 02 11:43:14.660851 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.660826 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:14.694541 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694520 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694652 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694553 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694652 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694573 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694647 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2f2m\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-kube-api-access-g2f2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694686 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694708 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694837 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694780 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694837 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694813 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.694908 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.694835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795310 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795279 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795427 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795315 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795427 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795352 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2f2m\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-kube-api-access-g2f2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795427 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795392 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795573 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795546 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795651 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795636 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795707 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795684 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795707 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795698 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795817 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795725 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795817 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795728 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.795817 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.795760 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.796026 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.796002 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.796153 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.796046 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.796417 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.796399 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.797680 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.797660 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.797925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.797907 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.811142 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.811115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.812207 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.812187 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2f2m\" (UniqueName: \"kubernetes.io/projected/b0f66a32-8d6e-432e-8ec1-0d3544d552dc-kube-api-access-g2f2m\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4t2fc8\" (UID: \"b0f66a32-8d6e-432e-8ec1-0d3544d552dc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.914537 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.914471 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:14.933755 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:14.931739 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:15.056632 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.056599 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:15.065720 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.065698 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8"] Jul 02 11:43:15.068086 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:43:15.068059 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f66a32_8d6e_432e_8ec1_0d3544d552dc.slice/crio-d48c57b9abeea489a0195e546b6ddb51662a63ef105c00f208a9c7b72511bfa2 WatchSource:0}: Error finding container d48c57b9abeea489a0195e546b6ddb51662a63ef105c00f208a9c7b72511bfa2: Status 404 returned error can't find the container with id d48c57b9abeea489a0195e546b6ddb51662a63ef105c00f208a9c7b72511bfa2 Jul 02 11:43:15.491400 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.491369 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" event={"ID":"b0f66a32-8d6e-432e-8ec1-0d3544d552dc","Type":"ContainerStarted","Data":"d48c57b9abeea489a0195e546b6ddb51662a63ef105c00f208a9c7b72511bfa2"} Jul 02 11:43:15.650969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.650936 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9"] Jul 02 11:43:15.655439 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.655419 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.660735 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.660716 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 11:43:15.661023 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.660998 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 11:43:15.661892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.661874 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 11:43:15.662990 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.662972 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 11:43:15.667674 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.667657 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 11:43:15.672127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.672108 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9"] Jul 02 11:43:15.672415 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.672396 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cvqtl\"" Jul 02 11:43:15.703483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.703460 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pf9d\" (UniqueName: \"kubernetes.io/projected/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-kube-api-access-6pf9d\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.703587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.703502 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-metrics-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.703587 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.703532 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-manager-config\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.703687 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.703609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.804613 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.804587 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-manager-config\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.804736 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.804630 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.804736 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.804698 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pf9d\" (UniqueName: \"kubernetes.io/projected/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-kube-api-access-6pf9d\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.804848 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.804757 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-metrics-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.805342 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.805307 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-manager-config\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.807173 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.807146 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.807294 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.807240 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-metrics-cert\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.824150 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.824125 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pf9d\" (UniqueName: \"kubernetes.io/projected/f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e-kube-api-access-6pf9d\") pod \"lws-controller-manager-c9658df68-kh8x9\" (UID: \"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e\") " pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:15.965368 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:15.965341 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:16.126237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:16.126134 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9"] Jul 02 11:43:16.129020 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:43:16.128987 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60e9ec3_2ad0_4d1a_b048_d504fb41ed1e.slice/crio-354ec47887b53e87b72dc80b1c27a9b5a093d5f85dd92de3d63d6a95f92adcae WatchSource:0}: Error finding container 354ec47887b53e87b72dc80b1c27a9b5a093d5f85dd92de3d63d6a95f92adcae: Status 404 returned error can't find the container with id 354ec47887b53e87b72dc80b1c27a9b5a093d5f85dd92de3d63d6a95f92adcae Jul 02 11:43:16.499367 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:16.499285 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" event={"ID":"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e","Type":"ContainerStarted","Data":"354ec47887b53e87b72dc80b1c27a9b5a093d5f85dd92de3d63d6a95f92adcae"} Jul 02 11:43:17.959575 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:17.959537 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 11:43:17.959872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:17.959612 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 11:43:17.959872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:17.959644 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 02 11:43:18.512603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:18.512558 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" event={"ID":"b0f66a32-8d6e-432e-8ec1-0d3544d552dc","Type":"ContainerStarted","Data":"2d0a501bf84043ed32e8c2ac6a54493e82540f4b49de9d69ce9252ff3f788d21"} Jul 02 11:43:18.593987 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:18.593938 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" podStartSLOduration=1.704700621 podStartE2EDuration="4.59392291s" totalImagesPullingTime="2.889222289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:43:18.592218212 +0000 UTC m=+362.286253337" watchObservedRunningTime="2026-07-02 11:43:18.59392291 +0000 UTC m=+362.287958035" Jul 02 11:43:18.914581 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:18.914551 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:19.068958 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.068858 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:19.225178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.225141 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:19.519272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.519159 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" event={"ID":"f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e","Type":"ContainerStarted","Data":"d2f12f5e0da1a0e59a43c04afa8340f39061ae21868aab77eb4565d66df392ba"} Jul 02 11:43:19.519272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.519244 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:19.919455 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.919428 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:19.969776 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:19.969723 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" podStartSLOduration=2.303593369 podStartE2EDuration="4.96970729s" totalImagesPullingTime="2.666113921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:43:19.567430781 +0000 UTC m=+363.261465906" watchObservedRunningTime="2026-07-02 11:43:19.96970729 +0000 UTC m=+363.663742415" Jul 02 11:43:20.523910 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:20.523881 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:20.524917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:20.524896 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4t2fc8" Jul 02 11:43:20.865200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:20.865116 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:21.201224 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:21.201138 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:21.329314 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:21.329275 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:22.496371 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:22.496341 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:22.732386 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:22.732354 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:30.526142 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:30.526109 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c9658df68-kh8x9" Jul 02 11:43:41.795221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:41.795177 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:43:41.889905 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:43:41.889867 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:07.863694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:07.863654 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:07.960925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:07.960891 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:08.059785 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:08.059741 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:23.774453 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.774416 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8"] Jul 02 11:44:23.776799 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.776773 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.780758 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.780738 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 11:44:23.780882 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.780826 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 11:44:23.782053 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.782035 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tbqgl\"" Jul 02 11:44:23.791970 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.791940 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8"] Jul 02 11:44:23.833123 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.833094 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2mp\" (UniqueName: \"kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.833228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.833139 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.833228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.833208 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.933818 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.933778 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mp\" (UniqueName: \"kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.933818 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.933824 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.934005 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.933853 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.934151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.934134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.934237 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.934215 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:23.944984 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:23.944960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2mp\" (UniqueName: \"kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:24.086048 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.085986 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:24.227769 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:44:24.227737 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97072bbf_1851_4a57_b60b_44c4ab459948.slice/crio-836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175 WatchSource:0}: Error finding container 836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175: Status 404 returned error can't find the container with id 836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175 Jul 02 11:44:24.228869 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.228844 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8"] Jul 02 11:44:24.600348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.600262 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p"] Jul 02 11:44:24.602695 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.602679 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.619184 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.619161 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p"] Jul 02 11:44:24.639867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.639835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.639980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.639878 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ptjx\" (UniqueName: \"kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.639980 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.639912 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.740670 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.740639 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.740796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.740698 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.740796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.740726 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ptjx\" (UniqueName: \"kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.741012 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.740989 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.741088 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.741055 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.751216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.751187 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ptjx\" (UniqueName: \"kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.824410 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.824386 2551 generic.go:356] "Generic (PLEG): container finished" podID="97072bbf-1851-4a57-b60b-44c4ab459948" containerID="dee1ac35db814a1d97b31d1d650ee285015c01d0e6b1f896d14e1cbf75ee331e" exitCode=0 Jul 02 11:44:24.824753 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.824459 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" event={"ID":"97072bbf-1851-4a57-b60b-44c4ab459948","Type":"ContainerDied","Data":"dee1ac35db814a1d97b31d1d650ee285015c01d0e6b1f896d14e1cbf75ee331e"} Jul 02 11:44:24.824753 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.824498 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" event={"ID":"97072bbf-1851-4a57-b60b-44c4ab459948","Type":"ContainerStarted","Data":"836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175"} Jul 02 11:44:24.911949 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.911879 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:24.999295 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:24.999263 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft"] Jul 02 11:44:25.007767 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.007738 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.008772 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.008735 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft"] Jul 02 11:44:25.044266 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.044217 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kr7p\" (UniqueName: \"kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.044402 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.044279 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.044448 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.044412 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.046066 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.046047 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p"] Jul 02 11:44:25.048040 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:44:25.048016 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63fff58_0044_426a_b227_6e7225fd49fb.slice/crio-b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e WatchSource:0}: Error finding container b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e: Status 404 returned error can't find the container with id b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e Jul 02 11:44:25.145700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.145672 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.145809 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.145765 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.145858 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.145828 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kr7p\" (UniqueName: \"kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.146055 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.146033 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.146165 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.146149 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.153988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.153967 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kr7p\" (UniqueName: \"kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.318689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.318661 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:25.363312 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.363280 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr"] Jul 02 11:44:25.366275 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.366236 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.381526 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.381499 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr"] Jul 02 11:44:25.447602 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.447570 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrdn\" (UniqueName: \"kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.447757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.447609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.447757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.447691 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.454782 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.454763 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft"] Jul 02 11:44:25.455844 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:44:25.455822 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0f14c7_6c18_426b_be5e_54358ec16fdd.slice/crio-2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7 WatchSource:0}: Error finding container 2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7: Status 404 returned error can't find the container with id 2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7 Jul 02 11:44:25.548634 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.548606 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrdn\" (UniqueName: \"kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.548762 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.548647 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.548762 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.548692 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.549052 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.549032 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.549119 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.549062 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.559046 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.559027 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrdn\" (UniqueName: \"kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.681375 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.681323 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:25.814260 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.814222 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr"] Jul 02 11:44:25.816296 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:44:25.816270 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e54a2f4_3145_403a_9d6c_8f31d9fecb25.slice/crio-81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686 WatchSource:0}: Error finding container 81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686: Status 404 returned error can't find the container with id 81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686 Jul 02 11:44:25.830792 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.830768 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" event={"ID":"0e54a2f4-3145-403a-9d6c-8f31d9fecb25","Type":"ContainerStarted","Data":"81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686"} Jul 02 11:44:25.832235 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.832211 2551 generic.go:356] "Generic (PLEG): container finished" podID="b63fff58-0044-426a-b227-6e7225fd49fb" containerID="665a90e4751b370ef4c47525c6bdcb2bfbeaa10d6ef3c745c5df5beb82c4d71b" exitCode=0 Jul 02 11:44:25.832349 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.832299 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" event={"ID":"b63fff58-0044-426a-b227-6e7225fd49fb","Type":"ContainerDied","Data":"665a90e4751b370ef4c47525c6bdcb2bfbeaa10d6ef3c745c5df5beb82c4d71b"} Jul 02 11:44:25.832407 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.832351 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" event={"ID":"b63fff58-0044-426a-b227-6e7225fd49fb","Type":"ContainerStarted","Data":"b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e"} Jul 02 11:44:25.834071 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.834047 2551 generic.go:356] "Generic (PLEG): container finished" podID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerID="caa2d01d0109278a12e4c8642d063fe5893319969c36f0b49e1e86f4311a660e" exitCode=0 Jul 02 11:44:25.834186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.834103 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" event={"ID":"1f0f14c7-6c18-426b-be5e-54358ec16fdd","Type":"ContainerDied","Data":"caa2d01d0109278a12e4c8642d063fe5893319969c36f0b49e1e86f4311a660e"} Jul 02 11:44:25.834186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:25.834143 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" event={"ID":"1f0f14c7-6c18-426b-be5e-54358ec16fdd","Type":"ContainerStarted","Data":"2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7"} Jul 02 11:44:26.841707 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.841664 2551 generic.go:356] "Generic (PLEG): container finished" podID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerID="bf72e48e9b60b1ec9ed63f26742b23e950e16b0d942a60b12c583624bdc6196b" exitCode=0 Jul 02 11:44:26.842139 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.841737 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" event={"ID":"0e54a2f4-3145-403a-9d6c-8f31d9fecb25","Type":"ContainerDied","Data":"bf72e48e9b60b1ec9ed63f26742b23e950e16b0d942a60b12c583624bdc6196b"} Jul 02 11:44:26.844067 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.844031 2551 generic.go:356] "Generic (PLEG): container finished" podID="97072bbf-1851-4a57-b60b-44c4ab459948" containerID="e510af98a011f7c8b44699cbc648e2eb38a79ed7eafc79034a36e1571bcf6c8b" exitCode=0 Jul 02 11:44:26.844202 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.844115 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" event={"ID":"97072bbf-1851-4a57-b60b-44c4ab459948","Type":"ContainerDied","Data":"e510af98a011f7c8b44699cbc648e2eb38a79ed7eafc79034a36e1571bcf6c8b"} Jul 02 11:44:26.846304 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.846215 2551 generic.go:356] "Generic (PLEG): container finished" podID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerID="cd3c5c06491889881576f35c3331de6036012c0c6e9e1fdce3d62f44e21d152a" exitCode=0 Jul 02 11:44:26.846443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:26.846346 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" event={"ID":"1f0f14c7-6c18-426b-be5e-54358ec16fdd","Type":"ContainerDied","Data":"cd3c5c06491889881576f35c3331de6036012c0c6e9e1fdce3d62f44e21d152a"} Jul 02 11:44:27.852490 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.852456 2551 generic.go:356] "Generic (PLEG): container finished" podID="b63fff58-0044-426a-b227-6e7225fd49fb" containerID="0c812ec493a491f86996f09fc3bcb323cddec088541394e986d09422be7eec04" exitCode=0 Jul 02 11:44:27.852904 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.852532 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" event={"ID":"b63fff58-0044-426a-b227-6e7225fd49fb","Type":"ContainerDied","Data":"0c812ec493a491f86996f09fc3bcb323cddec088541394e986d09422be7eec04"} Jul 02 11:44:27.854757 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.854727 2551 generic.go:356] "Generic (PLEG): container finished" podID="97072bbf-1851-4a57-b60b-44c4ab459948" containerID="b6dc73d45eee5ea8e90595d072bd4e3b87b6d71b62bdf1584fadf415f1362a19" exitCode=0 Jul 02 11:44:27.854845 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.854811 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" event={"ID":"97072bbf-1851-4a57-b60b-44c4ab459948","Type":"ContainerDied","Data":"b6dc73d45eee5ea8e90595d072bd4e3b87b6d71b62bdf1584fadf415f1362a19"} Jul 02 11:44:27.856946 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.856922 2551 generic.go:356] "Generic (PLEG): container finished" podID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerID="9ce84d11a9e83c11bb914f494b09490f93e64a4226361597dee9cb2c38c16b07" exitCode=0 Jul 02 11:44:27.857072 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:27.856982 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" event={"ID":"1f0f14c7-6c18-426b-be5e-54358ec16fdd","Type":"ContainerDied","Data":"9ce84d11a9e83c11bb914f494b09490f93e64a4226361597dee9cb2c38c16b07"} Jul 02 11:44:27.982298 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:44:27.980551 2551 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63fff58_0044_426a_b227_6e7225fd49fb.slice/crio-aad093255849c2ee3651637366e09df28e6184b7d481e708421187ab6b76e5ee.scope\": RecentStats: unable to find data in memory cache]" Jul 02 11:44:28.863121 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:28.863090 2551 generic.go:356] "Generic (PLEG): container finished" podID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerID="e99d5feaad8e976f239e94f3965c58651061d3c0c1c23bd1423bd2be4f522791" exitCode=0 Jul 02 11:44:28.863603 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:28.863161 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" event={"ID":"0e54a2f4-3145-403a-9d6c-8f31d9fecb25","Type":"ContainerDied","Data":"e99d5feaad8e976f239e94f3965c58651061d3c0c1c23bd1423bd2be4f522791"} Jul 02 11:44:28.865387 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:28.865358 2551 generic.go:356] "Generic (PLEG): container finished" podID="b63fff58-0044-426a-b227-6e7225fd49fb" containerID="aad093255849c2ee3651637366e09df28e6184b7d481e708421187ab6b76e5ee" exitCode=0 Jul 02 11:44:28.865488 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:28.865439 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" event={"ID":"b63fff58-0044-426a-b227-6e7225fd49fb","Type":"ContainerDied","Data":"aad093255849c2ee3651637366e09df28e6184b7d481e708421187ab6b76e5ee"} Jul 02 11:44:29.010575 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.010548 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:29.078145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.078121 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p2mp\" (UniqueName: \"kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp\") pod \"97072bbf-1851-4a57-b60b-44c4ab459948\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " Jul 02 11:44:29.078341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.078168 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util\") pod \"97072bbf-1851-4a57-b60b-44c4ab459948\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " Jul 02 11:44:29.078341 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.078192 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle\") pod \"97072bbf-1851-4a57-b60b-44c4ab459948\" (UID: \"97072bbf-1851-4a57-b60b-44c4ab459948\") " Jul 02 11:44:29.078689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.078664 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle" (OuterVolumeSpecName: "bundle") pod "97072bbf-1851-4a57-b60b-44c4ab459948" (UID: "97072bbf-1851-4a57-b60b-44c4ab459948"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:29.080167 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.080145 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp" (OuterVolumeSpecName: "kube-api-access-7p2mp") pod "97072bbf-1851-4a57-b60b-44c4ab459948" (UID: "97072bbf-1851-4a57-b60b-44c4ab459948"). InnerVolumeSpecName "kube-api-access-7p2mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:44:29.083820 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.083798 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util" (OuterVolumeSpecName: "util") pod "97072bbf-1851-4a57-b60b-44c4ab459948" (UID: "97072bbf-1851-4a57-b60b-44c4ab459948"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:29.109137 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.109119 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:29.179358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179294 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kr7p\" (UniqueName: \"kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p\") pod \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " Jul 02 11:44:29.179490 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179373 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util\") pod \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " Jul 02 11:44:29.179490 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179442 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle\") pod \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\" (UID: \"1f0f14c7-6c18-426b-be5e-54358ec16fdd\") " Jul 02 11:44:29.179642 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179628 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.179704 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179643 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p2mp\" (UniqueName: \"kubernetes.io/projected/97072bbf-1851-4a57-b60b-44c4ab459948-kube-api-access-7p2mp\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.179704 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.179651 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97072bbf-1851-4a57-b60b-44c4ab459948-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.180096 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.180067 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle" (OuterVolumeSpecName: "bundle") pod "1f0f14c7-6c18-426b-be5e-54358ec16fdd" (UID: "1f0f14c7-6c18-426b-be5e-54358ec16fdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:29.181314 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.181292 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p" (OuterVolumeSpecName: "kube-api-access-9kr7p") pod "1f0f14c7-6c18-426b-be5e-54358ec16fdd" (UID: "1f0f14c7-6c18-426b-be5e-54358ec16fdd"). InnerVolumeSpecName "kube-api-access-9kr7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:44:29.184891 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.184861 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util" (OuterVolumeSpecName: "util") pod "1f0f14c7-6c18-426b-be5e-54358ec16fdd" (UID: "1f0f14c7-6c18-426b-be5e-54358ec16fdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:29.280870 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.280849 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.280870 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.280869 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f0f14c7-6c18-426b-be5e-54358ec16fdd-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.280996 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.280878 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kr7p\" (UniqueName: \"kubernetes.io/projected/1f0f14c7-6c18-426b-be5e-54358ec16fdd-kube-api-access-9kr7p\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:29.872207 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.872170 2551 generic.go:356] "Generic (PLEG): container finished" podID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerID="c2e7fb68e9e26e9f6387b6d1b49190a730364841c756c1b61491243debfed979" exitCode=0 Jul 02 11:44:29.872674 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.872272 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" event={"ID":"0e54a2f4-3145-403a-9d6c-8f31d9fecb25","Type":"ContainerDied","Data":"c2e7fb68e9e26e9f6387b6d1b49190a730364841c756c1b61491243debfed979"} Jul 02 11:44:29.873999 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.873980 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" Jul 02 11:44:29.874133 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.874003 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8" event={"ID":"97072bbf-1851-4a57-b60b-44c4ab459948","Type":"ContainerDied","Data":"836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175"} Jul 02 11:44:29.874133 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.874040 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836ef588149bebe72661684f9b00dec9f52e865461120ca84ace371b5e310175" Jul 02 11:44:29.875828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.875804 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" Jul 02 11:44:29.875916 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.875853 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft" event={"ID":"1f0f14c7-6c18-426b-be5e-54358ec16fdd","Type":"ContainerDied","Data":"2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7"} Jul 02 11:44:29.875916 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.875887 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2998a20946e903dd0ac7fbf8dd3e95e31ff95dbff70d9cbee81de7c3c4f687f7" Jul 02 11:44:29.989849 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:29.989828 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:30.085637 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.085606 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle\") pod \"b63fff58-0044-426a-b227-6e7225fd49fb\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " Jul 02 11:44:30.085793 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.085665 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util\") pod \"b63fff58-0044-426a-b227-6e7225fd49fb\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " Jul 02 11:44:30.085793 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.085717 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ptjx\" (UniqueName: \"kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx\") pod \"b63fff58-0044-426a-b227-6e7225fd49fb\" (UID: \"b63fff58-0044-426a-b227-6e7225fd49fb\") " Jul 02 11:44:30.086040 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.086018 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle" (OuterVolumeSpecName: "bundle") pod "b63fff58-0044-426a-b227-6e7225fd49fb" (UID: "b63fff58-0044-426a-b227-6e7225fd49fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:30.087777 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.087750 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx" (OuterVolumeSpecName: "kube-api-access-8ptjx") pod "b63fff58-0044-426a-b227-6e7225fd49fb" (UID: "b63fff58-0044-426a-b227-6e7225fd49fb"). InnerVolumeSpecName "kube-api-access-8ptjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:44:30.090948 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.090925 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util" (OuterVolumeSpecName: "util") pod "b63fff58-0044-426a-b227-6e7225fd49fb" (UID: "b63fff58-0044-426a-b227-6e7225fd49fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:30.187313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.187229 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ptjx\" (UniqueName: \"kubernetes.io/projected/b63fff58-0044-426a-b227-6e7225fd49fb-kube-api-access-8ptjx\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:30.187313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.187278 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:30.187313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.187288 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b63fff58-0044-426a-b227-6e7225fd49fb-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:30.881670 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.881625 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" event={"ID":"b63fff58-0044-426a-b227-6e7225fd49fb","Type":"ContainerDied","Data":"b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e"} Jul 02 11:44:30.881670 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.881656 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p" Jul 02 11:44:30.882083 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:30.881682 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0860f83714706af2dc1925184d37f2233d80522832867181f1f5c31db8b314e" Jul 02 11:44:31.009876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.009850 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:31.095552 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.095474 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle\") pod \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " Jul 02 11:44:31.095681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.095555 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnrdn\" (UniqueName: \"kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn\") pod \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " Jul 02 11:44:31.095681 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.095655 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util\") pod \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\" (UID: \"0e54a2f4-3145-403a-9d6c-8f31d9fecb25\") " Jul 02 11:44:31.096114 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.096078 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle" (OuterVolumeSpecName: "bundle") pod "0e54a2f4-3145-403a-9d6c-8f31d9fecb25" (UID: "0e54a2f4-3145-403a-9d6c-8f31d9fecb25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:31.097595 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.097570 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn" (OuterVolumeSpecName: "kube-api-access-xnrdn") pod "0e54a2f4-3145-403a-9d6c-8f31d9fecb25" (UID: "0e54a2f4-3145-403a-9d6c-8f31d9fecb25"). InnerVolumeSpecName "kube-api-access-xnrdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:44:31.164808 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.164780 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util" (OuterVolumeSpecName: "util") pod "0e54a2f4-3145-403a-9d6c-8f31d9fecb25" (UID: "0e54a2f4-3145-403a-9d6c-8f31d9fecb25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:44:31.196792 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.196769 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:31.196792 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.196791 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:31.196900 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.196800 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnrdn\" (UniqueName: \"kubernetes.io/projected/0e54a2f4-3145-403a-9d6c-8f31d9fecb25-kube-api-access-xnrdn\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:44:31.887954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.887921 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" Jul 02 11:44:31.887954 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.887942 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr" event={"ID":"0e54a2f4-3145-403a-9d6c-8f31d9fecb25","Type":"ContainerDied","Data":"81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686"} Jul 02 11:44:31.888439 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:31.887992 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e82c9f0d7db17be0129be5dad8b4ce5b8944e128e5f1d32bc9cd86fb4a1686" Jul 02 11:44:37.189743 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:37.189707 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:37.790567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:37.790526 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:39.699812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:39.699731 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:39.769266 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:39.769218 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:41.436513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:41.436474 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:41.617674 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:41.617641 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:45.821131 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:45.821089 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:46.294152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:46.294108 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:47.545222 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:47.545185 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:49.653200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:49.653170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:50.111689 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:50.111654 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:50.279402 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:50.279376 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:51.866094 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:51.866065 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:53.640501 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:53.640467 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:53.742732 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:53.742696 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:56.141746 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:56.141644 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:56.401268 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:56.401175 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:56.989178 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:56.989140 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:44:57.064749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:44:57.064713 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:05.549531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:05.549498 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:05.708856 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:05.708825 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:05.869234 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:05.869150 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:07.912050 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:07.912012 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:08.017573 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:08.017539 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:12.281355 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:12.281322 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:12.394320 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:12.394286 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:12.950031 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:12.949992 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:13.051606 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:13.051574 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:15.221450 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:15.221408 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:15.304982 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:15.304944 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:24.428245 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:24.428211 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:24.529450 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:24.529414 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:26.247221 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247183 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd9fc5d79-wtjlk"] Jul 02 11:45:26.247727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247694 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="pull" Jul 02 11:45:26.247727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247714 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="pull" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247734 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="extract" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247745 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="extract" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247754 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="util" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247769 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="util" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247783 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="pull" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247791 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="pull" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247804 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="util" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247811 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="util" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247820 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="extract" Jul 02 11:45:26.247843 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247828 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247848 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="util" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247856 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="util" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247866 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="pull" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247874 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="pull" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247883 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247892 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247905 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="util" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247912 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="util" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247921 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247928 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247942 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="pull" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.247950 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="pull" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.248040 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0f14c7-6c18-426b-be5e-54358ec16fdd" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.248054 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e54a2f4-3145-403a-9d6c-8f31d9fecb25" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.248064 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b63fff58-0044-426a-b227-6e7225fd49fb" containerName="extract" Jul 02 11:45:26.248348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.248075 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="97072bbf-1851-4a57-b60b-44c4ab459948" containerName="extract" Jul 02 11:45:26.251358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.251342 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.278147 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.278125 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd9fc5d79-wtjlk"] Jul 02 11:45:26.317567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-oauth-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317577 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-trusted-ca-bundle\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317594 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-oauth-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317647 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317804 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317709 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317804 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317733 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-service-ca\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.317804 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.317759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9c4x\" (UniqueName: \"kubernetes.io/projected/edad8e4c-a0a4-4475-8102-b6cef44d0750-kube-api-access-s9c4x\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.344931 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.344903 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:26.418104 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418078 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-oauth-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418114 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-trusted-ca-bundle\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418139 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-oauth-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418160 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418218 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418206 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418485 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418228 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-service-ca\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.418485 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.418269 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9c4x\" (UniqueName: \"kubernetes.io/projected/edad8e4c-a0a4-4475-8102-b6cef44d0750-kube-api-access-s9c4x\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.419380 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.419309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-service-ca\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.419501 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.419402 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-oauth-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.419501 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.419466 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.425546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.419947 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad8e4c-a0a4-4475-8102-b6cef44d0750-trusted-ca-bundle\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.426183 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.426158 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-oauth-config\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.427014 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.426991 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad8e4c-a0a4-4475-8102-b6cef44d0750-console-serving-cert\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.428789 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.428765 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9c4x\" (UniqueName: \"kubernetes.io/projected/edad8e4c-a0a4-4475-8102-b6cef44d0750-kube-api-access-s9c4x\") pod \"console-bd9fc5d79-wtjlk\" (UID: \"edad8e4c-a0a4-4475-8102-b6cef44d0750\") " pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.443924 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.443898 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:26.560064 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.560041 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:26.691404 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.691380 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd9fc5d79-wtjlk"] Jul 02 11:45:26.693006 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:45:26.692972 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedad8e4c_a0a4_4475_8102_b6cef44d0750.slice/crio-aca5ca4dc213d713d7289740fc9a9f880bbde35cff4b2cde12c332e6d18a6a1a WatchSource:0}: Error finding container aca5ca4dc213d713d7289740fc9a9f880bbde35cff4b2cde12c332e6d18a6a1a: Status 404 returned error can't find the container with id aca5ca4dc213d713d7289740fc9a9f880bbde35cff4b2cde12c332e6d18a6a1a Jul 02 11:45:26.887793 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.887688 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:26.949800 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:26.949774 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:27.147205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:27.147132 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9fc5d79-wtjlk" event={"ID":"edad8e4c-a0a4-4475-8102-b6cef44d0750","Type":"ContainerStarted","Data":"85645a58eb88213fb5e7d5a8f27a7367a5a1a1f5bddf6c093122e6414f15d3ae"} Jul 02 11:45:27.147205 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:27.147183 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd9fc5d79-wtjlk" event={"ID":"edad8e4c-a0a4-4475-8102-b6cef44d0750","Type":"ContainerStarted","Data":"aca5ca4dc213d713d7289740fc9a9f880bbde35cff4b2cde12c332e6d18a6a1a"} Jul 02 11:45:27.168547 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:27.168500 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd9fc5d79-wtjlk" podStartSLOduration=1.16848673 podStartE2EDuration="1.16848673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:45:27.166483979 +0000 UTC m=+490.860519105" watchObservedRunningTime="2026-07-02 11:45:27.16848673 +0000 UTC m=+490.862521855" Jul 02 11:45:36.560608 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:36.560574 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:36.560983 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:36.560623 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:36.565029 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:36.565008 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:37.196135 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:37.196108 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd9fc5d79-wtjlk" Jul 02 11:45:37.243801 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:37.243767 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:45:37.351788 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:37.351754 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:37.452792 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:37.452703 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:37.901508 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:37.901472 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:48.042867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:48.042831 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:48.251361 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:48.251326 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:53.189906 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:53.189868 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:53.285943 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:53.285909 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:53.349223 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:53.349187 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:54.029358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.029323 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:45:54.032639 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.032620 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:45:54.035606 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.035570 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 11:45:54.035746 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.035618 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 11:45:54.035746 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.035643 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8znhq\"" Jul 02 11:45:54.044181 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.044156 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:45:54.087214 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.087183 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:54.130708 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.130680 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcf28\" (UniqueName: \"kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28\") pod \"authorino-58cd955675-lcrks\" (UID: \"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2\") " pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:45:54.181037 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.180998 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:45:54.185550 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.185526 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:45:54.188712 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.188695 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:45:54.197335 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.197316 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:45:54.231652 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.231624 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcf28\" (UniqueName: \"kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28\") pod \"authorino-58cd955675-lcrks\" (UID: \"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2\") " pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:45:54.240614 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.240589 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcf28\" (UniqueName: \"kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28\") pod \"authorino-58cd955675-lcrks\" (UID: \"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2\") " pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:45:54.332968 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.332905 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45sx9\" (UniqueName: \"kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9\") pod \"authorino-75d556bd77-jhlvt\" (UID: \"8f7d2556-03e0-4aab-a048-13d061db4526\") " pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:45:54.342794 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.342773 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:45:54.433926 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.433891 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45sx9\" (UniqueName: \"kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9\") pod \"authorino-75d556bd77-jhlvt\" (UID: \"8f7d2556-03e0-4aab-a048-13d061db4526\") " pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:45:54.442575 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.442547 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45sx9\" (UniqueName: \"kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9\") pod \"authorino-75d556bd77-jhlvt\" (UID: \"8f7d2556-03e0-4aab-a048-13d061db4526\") " pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:45:54.472998 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.472973 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:45:54.475274 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:45:54.475228 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e3b0d87_d3dd_4341_87f2_c1e5df212fd2.slice/crio-dee0e0230e90dfc86938c7e28eb9f991e54efac0d3e0f5caad3e88896573a211 WatchSource:0}: Error finding container dee0e0230e90dfc86938c7e28eb9f991e54efac0d3e0f5caad3e88896573a211: Status 404 returned error can't find the container with id dee0e0230e90dfc86938c7e28eb9f991e54efac0d3e0f5caad3e88896573a211 Jul 02 11:45:54.498187 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.498157 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:45:54.624798 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:54.624774 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:45:54.626626 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:45:54.626596 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f7d2556_03e0_4aab_a048_13d061db4526.slice/crio-956af96c720ca512cf0675f604c3b6b8be6e56f5a05207be81874872626229d9 WatchSource:0}: Error finding container 956af96c720ca512cf0675f604c3b6b8be6e56f5a05207be81874872626229d9: Status 404 returned error can't find the container with id 956af96c720ca512cf0675f604c3b6b8be6e56f5a05207be81874872626229d9 Jul 02 11:45:55.292152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:55.292115 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jhlvt" event={"ID":"8f7d2556-03e0-4aab-a048-13d061db4526","Type":"ContainerStarted","Data":"956af96c720ca512cf0675f604c3b6b8be6e56f5a05207be81874872626229d9"} Jul 02 11:45:55.293531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:55.293499 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcrks" event={"ID":"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2","Type":"ContainerStarted","Data":"dee0e0230e90dfc86938c7e28eb9f991e54efac0d3e0f5caad3e88896573a211"} Jul 02 11:45:59.318272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:59.318213 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jhlvt" event={"ID":"8f7d2556-03e0-4aab-a048-13d061db4526","Type":"ContainerStarted","Data":"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9"} Jul 02 11:45:59.319684 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:59.319653 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcrks" event={"ID":"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2","Type":"ContainerStarted","Data":"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928"} Jul 02 11:45:59.336311 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:59.336242 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jhlvt" podStartSLOduration=1.584129855 podStartE2EDuration="5.336228556s" totalImagesPullingTime="3.752098701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:45:59.335146639 +0000 UTC m=+523.029181765" watchObservedRunningTime="2026-07-02 11:45:59.336228556 +0000 UTC m=+523.030263722" Jul 02 11:45:59.356993 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:59.356945 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lcrks" podStartSLOduration=1.44264113 podStartE2EDuration="5.356931386s" totalImagesPullingTime="3.914290256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:45:59.355035585 +0000 UTC m=+523.049070709" watchObservedRunningTime="2026-07-02 11:45:59.356931386 +0000 UTC m=+523.050966513" Jul 02 11:45:59.383892 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:45:59.383855 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:46:01.329194 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:01.329154 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lcrks" podUID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" containerName="authorino" containerID="cri-o://e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928" gracePeriod=30 Jul 02 11:46:01.583050 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:01.582994 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:46:01.699364 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:01.699319 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcf28\" (UniqueName: \"kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28\") pod \"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2\" (UID: \"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2\") " Jul 02 11:46:01.701294 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:01.701263 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28" (OuterVolumeSpecName: "kube-api-access-rcf28") pod "1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" (UID: "1e3b0d87-d3dd-4341-87f2-c1e5df212fd2"). InnerVolumeSpecName "kube-api-access-rcf28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:46:01.800644 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:01.800605 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcf28\" (UniqueName: \"kubernetes.io/projected/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2-kube-api-access-rcf28\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.271001 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.270960 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6bcc76559d-5pf8k" podUID="96b11da8-58c5-47c5-a227-171c62720a98" containerName="console" containerID="cri-o://ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b" gracePeriod=15 Jul 02 11:46:02.335363 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.335330 2551 generic.go:356] "Generic (PLEG): container finished" podID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" containerID="e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928" exitCode=0 Jul 02 11:46:02.335726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.335367 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lcrks" Jul 02 11:46:02.335726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.335421 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcrks" event={"ID":"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2","Type":"ContainerDied","Data":"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928"} Jul 02 11:46:02.335726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.335458 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lcrks" event={"ID":"1e3b0d87-d3dd-4341-87f2-c1e5df212fd2","Type":"ContainerDied","Data":"dee0e0230e90dfc86938c7e28eb9f991e54efac0d3e0f5caad3e88896573a211"} Jul 02 11:46:02.335726 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.335476 2551 scope.go:117] "RemoveContainer" containerID="e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928" Jul 02 11:46:02.362432 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.362405 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:46:02.370813 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.370790 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lcrks"] Jul 02 11:46:02.381458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.381432 2551 scope.go:117] "RemoveContainer" containerID="e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928" Jul 02 11:46:02.381745 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:46:02.381721 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928\": container with ID starting with e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928 not found: ID does not exist" containerID="e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928" Jul 02 11:46:02.381826 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.381756 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928"} err="failed to get container status \"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928\": rpc error: code = NotFound desc = could not find container \"e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928\": container with ID starting with e424c512bce27d8ecfac547ea423142c17f92792535372308a71da8473b60928 not found: ID does not exist" Jul 02 11:46:02.510899 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.510874 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:46:02.607339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607245 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607316 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607339 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607333 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607356 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607390 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607441 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.607616 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.607485 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hxgw\" (UniqueName: \"kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw\") pod \"96b11da8-58c5-47c5-a227-171c62720a98\" (UID: \"96b11da8-58c5-47c5-a227-171c62720a98\") " Jul 02 11:46:02.608423 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.608243 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca" (OuterVolumeSpecName: "service-ca") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:46:02.608423 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.608370 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:46:02.608423 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.608216 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config" (OuterVolumeSpecName: "console-config") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:46:02.610388 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.608785 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:46:02.610388 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.610289 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:46:02.611910 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.611870 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw" (OuterVolumeSpecName: "kube-api-access-4hxgw") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "kube-api-access-4hxgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:46:02.616073 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.615944 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96b11da8-58c5-47c5-a227-171c62720a98" (UID: "96b11da8-58c5-47c5-a227-171c62720a98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:46:02.709092 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709061 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-oauth-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709092 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709088 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hxgw\" (UniqueName: \"kubernetes.io/projected/96b11da8-58c5-47c5-a227-171c62720a98-kube-api-access-4hxgw\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709100 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-serving-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709110 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-service-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709119 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-console-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709127 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96b11da8-58c5-47c5-a227-171c62720a98-console-oauth-config\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.709286 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.709135 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b11da8-58c5-47c5-a227-171c62720a98-trusted-ca-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:02.817388 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:02.817359 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" path="/var/lib/kubelet/pods/1e3b0d87-d3dd-4341-87f2-c1e5df212fd2/volumes" Jul 02 11:46:03.342293 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.342262 2551 generic.go:356] "Generic (PLEG): container finished" podID="96b11da8-58c5-47c5-a227-171c62720a98" containerID="ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b" exitCode=0 Jul 02 11:46:03.342677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.342310 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc76559d-5pf8k" Jul 02 11:46:03.342677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.342323 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc76559d-5pf8k" event={"ID":"96b11da8-58c5-47c5-a227-171c62720a98","Type":"ContainerDied","Data":"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b"} Jul 02 11:46:03.342677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.342364 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc76559d-5pf8k" event={"ID":"96b11da8-58c5-47c5-a227-171c62720a98","Type":"ContainerDied","Data":"8d055f10bc4cea75c4232185cb52dfcb46a1845ee4a8bedef166c7e80bfd7158"} Jul 02 11:46:03.342677 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.342387 2551 scope.go:117] "RemoveContainer" containerID="ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b" Jul 02 11:46:03.350881 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.350864 2551 scope.go:117] "RemoveContainer" containerID="ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b" Jul 02 11:46:03.351108 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:46:03.351092 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b\": container with ID starting with ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b not found: ID does not exist" containerID="ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b" Jul 02 11:46:03.351152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.351114 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b"} err="failed to get container status \"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b\": rpc error: code = NotFound desc = could not find container \"ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b\": container with ID starting with ace1378dc00758ecf5d9f9427454e73818b6f64eb00d249d526feb3313221e5b not found: ID does not exist" Jul 02 11:46:03.365865 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.365843 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:46:03.376127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:03.376101 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bcc76559d-5pf8k"] Jul 02 11:46:04.817154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:04.817120 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b11da8-58c5-47c5-a227-171c62720a98" path="/var/lib/kubelet/pods/96b11da8-58c5-47c5-a227-171c62720a98/volumes" Jul 02 11:46:09.737876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:09.737797 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:22.879876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:22.879836 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:22.946024 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:22.945981 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:23.145912 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:23.145827 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:24.373694 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.373660 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g"] Jul 02 11:46:24.374029 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.373986 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" containerName="authorino" Jul 02 11:46:24.374029 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.373997 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" containerName="authorino" Jul 02 11:46:24.374029 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.374008 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b11da8-58c5-47c5-a227-171c62720a98" containerName="console" Jul 02 11:46:24.374029 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.374014 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b11da8-58c5-47c5-a227-171c62720a98" containerName="console" Jul 02 11:46:24.374174 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.374080 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3b0d87-d3dd-4341-87f2-c1e5df212fd2" containerName="authorino" Jul 02 11:46:24.374174 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.374088 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b11da8-58c5-47c5-a227-171c62720a98" containerName="console" Jul 02 11:46:24.380288 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.379807 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.384269 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.384229 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qn5ht\"" Jul 02 11:46:24.384750 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.384721 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 11:46:24.385369 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.385345 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 11:46:24.388591 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.388529 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g"] Jul 02 11:46:24.472517 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.472484 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.472661 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.472530 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.472661 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.472618 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6jf\" (UniqueName: \"kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.573885 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.573854 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.574031 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.573926 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6jf\" (UniqueName: \"kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.574031 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.573987 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.574272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.574228 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.574371 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.574323 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.583820 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.583797 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6jf\" (UniqueName: \"kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf\") pod \"2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.690294 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.690214 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:24.824210 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:24.824179 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g"] Jul 02 11:46:24.826943 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:46:24.826920 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe53b3ef_50be_4f18_9ee2_1fb2d2b37fdc.slice/crio-1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c WatchSource:0}: Error finding container 1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c: Status 404 returned error can't find the container with id 1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c Jul 02 11:46:25.460515 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:25.460481 2551 generic.go:356] "Generic (PLEG): container finished" podID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerID="199ba7f2d0a2d1d81197a4bdccf3ef5afffb9305148e5d000ead417193464d71" exitCode=0 Jul 02 11:46:25.460975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:25.460544 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" event={"ID":"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc","Type":"ContainerDied","Data":"199ba7f2d0a2d1d81197a4bdccf3ef5afffb9305148e5d000ead417193464d71"} Jul 02 11:46:25.460975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:25.460594 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" event={"ID":"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc","Type":"ContainerStarted","Data":"1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c"} Jul 02 11:46:26.466735 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:26.466700 2551 generic.go:356] "Generic (PLEG): container finished" podID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerID="8c0b4ff45c6c1e57274dd7501a0a0d12bc944730ba6dbcdead1be64448bf9a6f" exitCode=0 Jul 02 11:46:26.467052 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:26.466778 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" event={"ID":"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc","Type":"ContainerDied","Data":"8c0b4ff45c6c1e57274dd7501a0a0d12bc944730ba6dbcdead1be64448bf9a6f"} Jul 02 11:46:27.473651 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:27.473622 2551 generic.go:356] "Generic (PLEG): container finished" podID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerID="746eef3af7eb8896bb22afc19c200111a12f963a537b8cf4f181db0cc67973fe" exitCode=0 Jul 02 11:46:27.474106 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:27.473669 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" event={"ID":"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc","Type":"ContainerDied","Data":"746eef3af7eb8896bb22afc19c200111a12f963a537b8cf4f181db0cc67973fe"} Jul 02 11:46:28.610727 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.610700 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:28.710080 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.710045 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle\") pod \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " Jul 02 11:46:28.710292 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.710094 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t6jf\" (UniqueName: \"kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf\") pod \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " Jul 02 11:46:28.710292 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.710167 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util\") pod \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\" (UID: \"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc\") " Jul 02 11:46:28.710614 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.710591 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle" (OuterVolumeSpecName: "bundle") pod "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" (UID: "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:46:28.712280 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.712244 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf" (OuterVolumeSpecName: "kube-api-access-4t6jf") pod "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" (UID: "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc"). InnerVolumeSpecName "kube-api-access-4t6jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:46:28.715984 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.715949 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util" (OuterVolumeSpecName: "util") pod "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" (UID: "fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 11:46:28.811464 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.811431 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-bundle\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:28.811464 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.811460 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t6jf\" (UniqueName: \"kubernetes.io/projected/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-kube-api-access-4t6jf\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:28.811671 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:28.811474 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc-util\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:46:29.485945 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:29.485917 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" Jul 02 11:46:29.486127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:29.485908 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2736463c5a4e6691c7a6ec457423dfda2e5f78fc1801325ffed26f71c88xt9g" event={"ID":"fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc","Type":"ContainerDied","Data":"1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c"} Jul 02 11:46:29.486127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:29.486043 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ccd377cf76b16e6954063e067829929162af42c53422f6a922073fe3100ff3c" Jul 02 11:46:47.555823 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:47.555777 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:47.880812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:47.880712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:48.040956 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.040923 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:46:48.041282 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041269 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="extract" Jul 02 11:46:48.041336 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041284 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="extract" Jul 02 11:46:48.041336 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041298 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="util" Jul 02 11:46:48.041336 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041303 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="util" Jul 02 11:46:48.041336 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041315 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="pull" Jul 02 11:46:48.041336 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041320 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="pull" Jul 02 11:46:48.041531 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.041373 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe53b3ef-50be-4f18-9ee2-1fb2d2b37fdc" containerName="extract" Jul 02 11:46:48.044265 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.044236 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:48.046738 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.046716 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 11:46:48.046860 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.046724 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 11:46:48.046860 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.046757 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-plmrx\"" Jul 02 11:46:48.046860 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.046837 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 11:46:48.055651 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.055633 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:46:48.151338 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.151266 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczrv\" (UniqueName: \"kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv\") pod \"maas-keycloak-0\" (UID: \"1c8b4f53-d4c9-4b31-81ee-b661389ff09d\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:48.252292 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.252266 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczrv\" (UniqueName: \"kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv\") pod \"maas-keycloak-0\" (UID: \"1c8b4f53-d4c9-4b31-81ee-b661389ff09d\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:48.261895 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.261866 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczrv\" (UniqueName: \"kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv\") pod \"maas-keycloak-0\" (UID: \"1c8b4f53-d4c9-4b31-81ee-b661389ff09d\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:48.354701 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.354673 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:48.487705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.487681 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:46:48.490364 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:46:48.490334 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8b4f53_d4c9_4b31_81ee_b661389ff09d.slice/crio-2d61c8a437993cea3046e52f57d810704bfe7ddadc4c18de34d288e678327e08 WatchSource:0}: Error finding container 2d61c8a437993cea3046e52f57d810704bfe7ddadc4c18de34d288e678327e08: Status 404 returned error can't find the container with id 2d61c8a437993cea3046e52f57d810704bfe7ddadc4c18de34d288e678327e08 Jul 02 11:46:48.586604 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:48.586572 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c8b4f53-d4c9-4b31-81ee-b661389ff09d","Type":"ContainerStarted","Data":"2d61c8a437993cea3046e52f57d810704bfe7ddadc4c18de34d288e678327e08"} Jul 02 11:46:51.929852 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:51.929817 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:46:53.625917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:53.625874 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c8b4f53-d4c9-4b31-81ee-b661389ff09d","Type":"ContainerStarted","Data":"890d396ed8762428aa480eedc86d6424cbbc11c3691bf48b18a8a9b004b81c33"} Jul 02 11:46:53.649076 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:53.649003 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.200781773 podStartE2EDuration="5.648984134s" totalImagesPullingTime="4.448202361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:46:53.646484411 +0000 UTC m=+577.340519535" watchObservedRunningTime="2026-07-02 11:46:53.648984134 +0000 UTC m=+577.343019261" Jul 02 11:46:54.355461 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:54.355418 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:54.357154 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:54.357116 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:46:55.355788 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:55.355749 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:46:56.355743 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:56.355685 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:46:57.355894 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:57.355838 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:46:58.355130 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:58.355090 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 11:46:58.356377 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:58.355684 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:46:59.356243 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:46:59.356186 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:00.355993 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:00.355939 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:01.355189 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:01.355131 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:02.356077 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:02.356015 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:03.355756 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:03.355697 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:04.356089 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:04.356038 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:05.355632 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:05.355573 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jul 02 11:47:06.477317 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:06.477279 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 11:47:06.495068 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:06.495007 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 11:47:16.483348 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:16.483316 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 11:47:16.778730 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:16.778705 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:47:16.778913 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:16.778775 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:47:16.783337 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:16.783317 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:47:16.783514 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:16.783491 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kphz6_cdb8f142-1572-40d8-b293-5b4019ed156f/ovn-acl-logging/0.log" Jul 02 11:47:17.191349 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.191272 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:17.354305 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.354236 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:17.403532 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.403500 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:17.409612 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.409593 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:17.418988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.418968 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:17.448535 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.448478 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpkr\" (UniqueName: \"kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr\") pod \"authorino-5d4b67c446-5tp4n\" (UID: \"eaeead56-b5bf-49ac-872e-bc348a31cb48\") " pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:17.549472 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.549446 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpkr\" (UniqueName: \"kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr\") pod \"authorino-5d4b67c446-5tp4n\" (UID: \"eaeead56-b5bf-49ac-872e-bc348a31cb48\") " pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:17.559814 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.559791 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpkr\" (UniqueName: \"kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr\") pod \"authorino-5d4b67c446-5tp4n\" (UID: \"eaeead56-b5bf-49ac-872e-bc348a31cb48\") " pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:17.682744 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.682714 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:17.682938 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.682926 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:17.721678 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.721520 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b777d7dbc-gdc2s"] Jul 02 11:47:17.724228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.724205 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:17.748657 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.741177 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b777d7dbc-gdc2s"] Jul 02 11:47:17.751005 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.750968 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfspl\" (UniqueName: \"kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl\") pod \"authorino-b777d7dbc-gdc2s\" (UID: \"4a75a120-9ee7-40d3-90a5-439c3e3ccadd\") " pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:17.832338 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.832314 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:17.834875 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:47:17.834847 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaeead56_b5bf_49ac_872e_bc348a31cb48.slice/crio-c31f0985ac2eaffd07d8752d370e1a6ab6c1e7db5b152b62f2c7493b6a116a2b WatchSource:0}: Error finding container c31f0985ac2eaffd07d8752d370e1a6ab6c1e7db5b152b62f2c7493b6a116a2b: Status 404 returned error can't find the container with id c31f0985ac2eaffd07d8752d370e1a6ab6c1e7db5b152b62f2c7493b6a116a2b Jul 02 11:47:17.849137 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.849111 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b777d7dbc-gdc2s"] Jul 02 11:47:17.849403 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:47:17.849384 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mfspl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-b777d7dbc-gdc2s" podUID="4a75a120-9ee7-40d3-90a5-439c3e3ccadd" Jul 02 11:47:17.852159 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.852143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfspl\" (UniqueName: \"kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl\") pod \"authorino-b777d7dbc-gdc2s\" (UID: \"4a75a120-9ee7-40d3-90a5-439c3e3ccadd\") " pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:17.863064 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.863036 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfspl\" (UniqueName: \"kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl\") pod \"authorino-b777d7dbc-gdc2s\" (UID: \"4a75a120-9ee7-40d3-90a5-439c3e3ccadd\") " pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:17.887177 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.887153 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:47:17.889431 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.889414 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:17.891937 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.891917 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 11:47:17.901307 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.901286 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:47:17.953233 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.953211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:17.953384 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:17.953304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgjf\" (UniqueName: \"kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.054030 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.054005 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.054164 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.054044 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgjf\" (UniqueName: \"kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.056231 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.056207 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.065099 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.065078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgjf\" (UniqueName: \"kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf\") pod \"authorino-69bf9f869f-6bdtx\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.197816 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.197784 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:47:18.324076 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.324047 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:47:18.325752 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:47:18.325727 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a6f82d7_57e7_4345_934c_e266261c41d4.slice/crio-d2d8dcb64ded237abf161ce4ec1417e725c93392cae81a54174d6e70863a4672 WatchSource:0}: Error finding container d2d8dcb64ded237abf161ce4ec1417e725c93392cae81a54174d6e70863a4672: Status 404 returned error can't find the container with id d2d8dcb64ded237abf161ce4ec1417e725c93392cae81a54174d6e70863a4672 Jul 02 11:47:18.809260 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.809207 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" event={"ID":"eaeead56-b5bf-49ac-872e-bc348a31cb48","Type":"ContainerStarted","Data":"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb"} Jul 02 11:47:18.809699 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.809269 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" event={"ID":"eaeead56-b5bf-49ac-872e-bc348a31cb48","Type":"ContainerStarted","Data":"c31f0985ac2eaffd07d8752d370e1a6ab6c1e7db5b152b62f2c7493b6a116a2b"} Jul 02 11:47:18.809699 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.809311 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" podUID="eaeead56-b5bf-49ac-872e-bc348a31cb48" containerName="authorino" containerID="cri-o://38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb" gracePeriod=30 Jul 02 11:47:18.811011 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.810986 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" event={"ID":"7a6f82d7-57e7-4345-934c-e266261c41d4","Type":"ContainerStarted","Data":"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf"} Jul 02 11:47:18.811145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.811021 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" event={"ID":"7a6f82d7-57e7-4345-934c-e266261c41d4","Type":"ContainerStarted","Data":"d2d8dcb64ded237abf161ce4ec1417e725c93392cae81a54174d6e70863a4672"} Jul 02 11:47:18.811145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.811040 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:18.819442 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.819424 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:18.830036 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.829987 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" podStartSLOduration=1.161239294 podStartE2EDuration="1.829970049s" totalImagesPullingTime="668.730755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:47:18.829316916 +0000 UTC m=+602.523352065" watchObservedRunningTime="2026-07-02 11:47:18.829970049 +0000 UTC m=+602.524005176" Jul 02 11:47:18.861704 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.861666 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfspl\" (UniqueName: \"kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl\") pod \"4a75a120-9ee7-40d3-90a5-439c3e3ccadd\" (UID: \"4a75a120-9ee7-40d3-90a5-439c3e3ccadd\") " Jul 02 11:47:18.863781 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.863758 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl" (OuterVolumeSpecName: "kube-api-access-mfspl") pod "4a75a120-9ee7-40d3-90a5-439c3e3ccadd" (UID: "4a75a120-9ee7-40d3-90a5-439c3e3ccadd"). InnerVolumeSpecName "kube-api-access-mfspl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:47:18.867493 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.867457 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" podStartSLOduration=1.5072995580000002 podStartE2EDuration="1.867443525s" totalImagesPullingTime="360.143967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:47:18.865930835 +0000 UTC m=+602.559965963" watchObservedRunningTime="2026-07-02 11:47:18.867443525 +0000 UTC m=+602.561478678" Jul 02 11:47:18.896359 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.896331 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:47:18.896507 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.896490 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jhlvt" podUID="8f7d2556-03e0-4aab-a048-13d061db4526" containerName="authorino" containerID="cri-o://041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9" gracePeriod=30 Jul 02 11:47:18.962641 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:18.962573 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfspl\" (UniqueName: \"kubernetes.io/projected/4a75a120-9ee7-40d3-90a5-439c3e3ccadd-kube-api-access-mfspl\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:47:19.155705 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.154205 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:19.157184 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.157162 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:47:19.163151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.163130 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45sx9\" (UniqueName: \"kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9\") pod \"8f7d2556-03e0-4aab-a048-13d061db4526\" (UID: \"8f7d2556-03e0-4aab-a048-13d061db4526\") " Jul 02 11:47:19.163270 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.163172 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdpkr\" (UniqueName: \"kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr\") pod \"eaeead56-b5bf-49ac-872e-bc348a31cb48\" (UID: \"eaeead56-b5bf-49ac-872e-bc348a31cb48\") " Jul 02 11:47:19.165110 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.165084 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9" (OuterVolumeSpecName: "kube-api-access-45sx9") pod "8f7d2556-03e0-4aab-a048-13d061db4526" (UID: "8f7d2556-03e0-4aab-a048-13d061db4526"). InnerVolumeSpecName "kube-api-access-45sx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:47:19.165110 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.165093 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr" (OuterVolumeSpecName: "kube-api-access-gdpkr") pod "eaeead56-b5bf-49ac-872e-bc348a31cb48" (UID: "eaeead56-b5bf-49ac-872e-bc348a31cb48"). InnerVolumeSpecName "kube-api-access-gdpkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:47:19.263913 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.263836 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45sx9\" (UniqueName: \"kubernetes.io/projected/8f7d2556-03e0-4aab-a048-13d061db4526-kube-api-access-45sx9\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:47:19.263913 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.263861 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdpkr\" (UniqueName: \"kubernetes.io/projected/eaeead56-b5bf-49ac-872e-bc348a31cb48-kube-api-access-gdpkr\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:47:19.816779 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.816702 2551 generic.go:356] "Generic (PLEG): container finished" podID="eaeead56-b5bf-49ac-872e-bc348a31cb48" containerID="38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb" exitCode=0 Jul 02 11:47:19.816779 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.816744 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" Jul 02 11:47:19.817225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.816782 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" event={"ID":"eaeead56-b5bf-49ac-872e-bc348a31cb48","Type":"ContainerDied","Data":"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb"} Jul 02 11:47:19.817225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.816819 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5tp4n" event={"ID":"eaeead56-b5bf-49ac-872e-bc348a31cb48","Type":"ContainerDied","Data":"c31f0985ac2eaffd07d8752d370e1a6ab6c1e7db5b152b62f2c7493b6a116a2b"} Jul 02 11:47:19.817225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.816837 2551 scope.go:117] "RemoveContainer" containerID="38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb" Jul 02 11:47:19.818164 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.818140 2551 generic.go:356] "Generic (PLEG): container finished" podID="8f7d2556-03e0-4aab-a048-13d061db4526" containerID="041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9" exitCode=0 Jul 02 11:47:19.818259 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.818173 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jhlvt" Jul 02 11:47:19.818259 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.818174 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jhlvt" event={"ID":"8f7d2556-03e0-4aab-a048-13d061db4526","Type":"ContainerDied","Data":"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9"} Jul 02 11:47:19.818259 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.818210 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jhlvt" event={"ID":"8f7d2556-03e0-4aab-a048-13d061db4526","Type":"ContainerDied","Data":"956af96c720ca512cf0675f604c3b6b8be6e56f5a05207be81874872626229d9"} Jul 02 11:47:19.818391 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.818320 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b777d7dbc-gdc2s" Jul 02 11:47:19.827243 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.827226 2551 scope.go:117] "RemoveContainer" containerID="38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb" Jul 02 11:47:19.827547 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:47:19.827527 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb\": container with ID starting with 38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb not found: ID does not exist" containerID="38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb" Jul 02 11:47:19.827624 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.827560 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb"} err="failed to get container status \"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb\": rpc error: code = NotFound desc = could not find container \"38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb\": container with ID starting with 38c474a674b560c84e092c13dbe2f8cb9fe2a710fc25569546da7632b170d6cb not found: ID does not exist" Jul 02 11:47:19.827624 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.827584 2551 scope.go:117] "RemoveContainer" containerID="041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9" Jul 02 11:47:19.835444 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.835427 2551 scope.go:117] "RemoveContainer" containerID="041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9" Jul 02 11:47:19.835669 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:47:19.835651 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9\": container with ID starting with 041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9 not found: ID does not exist" containerID="041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9" Jul 02 11:47:19.835733 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.835676 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9"} err="failed to get container status \"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9\": rpc error: code = NotFound desc = could not find container \"041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9\": container with ID starting with 041da5dcd6639dd756b9b383c3c1830993b39047797a92df1b2fe7b4d65219b9 not found: ID does not exist" Jul 02 11:47:19.856078 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.856059 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b777d7dbc-gdc2s"] Jul 02 11:47:19.859340 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.859321 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b777d7dbc-gdc2s"] Jul 02 11:47:19.870720 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.870702 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:47:19.874797 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.874780 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jhlvt"] Jul 02 11:47:19.886261 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.886228 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:19.890650 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:19.890629 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5tp4n"] Jul 02 11:47:20.816882 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:20.816842 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a75a120-9ee7-40d3-90a5-439c3e3ccadd" path="/var/lib/kubelet/pods/4a75a120-9ee7-40d3-90a5-439c3e3ccadd/volumes" Jul 02 11:47:20.817391 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:20.817142 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7d2556-03e0-4aab-a048-13d061db4526" path="/var/lib/kubelet/pods/8f7d2556-03e0-4aab-a048-13d061db4526/volumes" Jul 02 11:47:20.817568 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:20.817549 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaeead56-b5bf-49ac-872e-bc348a31cb48" path="/var/lib/kubelet/pods/eaeead56-b5bf-49ac-872e-bc348a31cb48/volumes" Jul 02 11:47:23.381773 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.381743 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:23.570916 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.570883 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4b7f5c49-t58dp"] Jul 02 11:47:23.571228 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571216 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7d2556-03e0-4aab-a048-13d061db4526" containerName="authorino" Jul 02 11:47:23.571298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571232 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7d2556-03e0-4aab-a048-13d061db4526" containerName="authorino" Jul 02 11:47:23.571298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571260 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaeead56-b5bf-49ac-872e-bc348a31cb48" containerName="authorino" Jul 02 11:47:23.571298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571267 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaeead56-b5bf-49ac-872e-bc348a31cb48" containerName="authorino" Jul 02 11:47:23.571392 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571335 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaeead56-b5bf-49ac-872e-bc348a31cb48" containerName="authorino" Jul 02 11:47:23.571392 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.571347 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f7d2556-03e0-4aab-a048-13d061db4526" containerName="authorino" Jul 02 11:47:23.573502 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.573485 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.577327 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.577303 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 11:47:23.577468 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.577331 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 11:47:23.578307 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.578288 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jkv55\"" Jul 02 11:47:23.583890 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.583869 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4b7f5c49-t58dp"] Jul 02 11:47:23.598635 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.598607 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1b665f-2395-43bd-ae84-d70a17ce48de-webhook-cert\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.598740 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.598669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knt9\" (UniqueName: \"kubernetes.io/projected/0a1b665f-2395-43bd-ae84-d70a17ce48de-kube-api-access-6knt9\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.699966 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.699909 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knt9\" (UniqueName: \"kubernetes.io/projected/0a1b665f-2395-43bd-ae84-d70a17ce48de-kube-api-access-6knt9\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.700056 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.699977 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1b665f-2395-43bd-ae84-d70a17ce48de-webhook-cert\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.702230 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.702211 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1b665f-2395-43bd-ae84-d70a17ce48de-webhook-cert\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.715024 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.714997 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knt9\" (UniqueName: \"kubernetes.io/projected/0a1b665f-2395-43bd-ae84-d70a17ce48de-kube-api-access-6knt9\") pod \"maas-controller-7d4b7f5c49-t58dp\" (UID: \"0a1b665f-2395-43bd-ae84-d70a17ce48de\") " pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:23.884071 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:23.884050 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:24.020523 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:24.020491 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4b7f5c49-t58dp"] Jul 02 11:47:24.022374 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:47:24.022352 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1b665f_2395_43bd_ae84_d70a17ce48de.slice/crio-7ccdae9f7462613179336fa25f6d3b41f98b86395f89658a2c579e531ffbb2b5 WatchSource:0}: Error finding container 7ccdae9f7462613179336fa25f6d3b41f98b86395f89658a2c579e531ffbb2b5: Status 404 returned error can't find the container with id 7ccdae9f7462613179336fa25f6d3b41f98b86395f89658a2c579e531ffbb2b5 Jul 02 11:47:24.848815 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:24.848768 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" event={"ID":"0a1b665f-2395-43bd-ae84-d70a17ce48de","Type":"ContainerStarted","Data":"7ccdae9f7462613179336fa25f6d3b41f98b86395f89658a2c579e531ffbb2b5"} Jul 02 11:47:25.186387 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:25.186269 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:25.975242 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:25.975202 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:26.779236 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:26.779199 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:26.862298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:26.862194 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" event={"ID":"0a1b665f-2395-43bd-ae84-d70a17ce48de","Type":"ContainerStarted","Data":"e707d5cc22d9ace394f8743b8c256545c35c927dfe2e53680246146cd59e79a2"} Jul 02 11:47:26.862298 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:26.862287 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:26.872302 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:26.872273 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:26.894370 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:26.894286 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" podStartSLOduration=1.3231105109999999 podStartE2EDuration="3.894268558s" totalImagesPullingTime="2.571158047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:47:26.89260606 +0000 UTC m=+610.586641187" watchObservedRunningTime="2026-07-02 11:47:26.894268558 +0000 UTC m=+610.588303684" Jul 02 11:47:37.873168 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:37.873137 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4b7f5c49-t58dp" Jul 02 11:47:58.326541 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.326502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:58.763070 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.762996 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5ccdd78dd9-9wjss"] Jul 02 11:47:58.771019 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.770992 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.774127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.774108 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 11:47:58.781465 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.781444 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5ccdd78dd9-9wjss"] Jul 02 11:47:58.783303 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.783280 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:58.880505 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.880478 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb5211-2350-473b-915c-71ead1ca7bb3-openshift-service-ca\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.880505 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.880508 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5cs\" (UniqueName: \"kubernetes.io/projected/3bbb5211-2350-473b-915c-71ead1ca7bb3-kube-api-access-pd5cs\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.880659 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.880586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.981896 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.981869 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.982025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.981921 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb5211-2350-473b-915c-71ead1ca7bb3-openshift-service-ca\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.982025 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.981939 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5cs\" (UniqueName: \"kubernetes.io/projected/3bbb5211-2350-473b-915c-71ead1ca7bb3-kube-api-access-pd5cs\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.982099 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:47:58.982024 2551 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 02 11:47:58.982145 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:47:58.982106 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls podName:3bbb5211-2350-473b-915c-71ead1ca7bb3 nodeName:}" failed. No retries permitted until 2026-07-02 11:47:59.482084812 +0000 UTC m=+643.176119926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls") pod "maas-api-5ccdd78dd9-9wjss" (UID: "3bbb5211-2350-473b-915c-71ead1ca7bb3") : secret "maas-api-serving-cert" not found Jul 02 11:47:58.982611 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.982576 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb5211-2350-473b-915c-71ead1ca7bb3-openshift-service-ca\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:58.991388 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:58.991359 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5cs\" (UniqueName: \"kubernetes.io/projected/3bbb5211-2350-473b-915c-71ead1ca7bb3-kube-api-access-pd5cs\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:59.228709 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.228673 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:59.354684 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.354656 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8h9mf"] Jul 02 11:47:59.363984 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.363924 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:59.417358 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.417332 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8h9mf"] Jul 02 11:47:59.417498 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.417416 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.422498 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.422471 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c9w46\"" Jul 02 11:47:59.422894 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.422877 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 11:47:59.485971 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.485890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04aa2a02-0598-4f44-bf9c-8676c5121652-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.485971 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.485940 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:59.486170 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.486013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc69k\" (UniqueName: \"kubernetes.io/projected/04aa2a02-0598-4f44-bf9c-8676c5121652-kube-api-access-fc69k\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.488272 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.488232 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bbb5211-2350-473b-915c-71ead1ca7bb3-maas-api-tls\") pod \"maas-api-5ccdd78dd9-9wjss\" (UID: \"3bbb5211-2350-473b-915c-71ead1ca7bb3\") " pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:59.539498 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.539469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:47:59.586917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.586884 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc69k\" (UniqueName: \"kubernetes.io/projected/04aa2a02-0598-4f44-bf9c-8676c5121652-kube-api-access-fc69k\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.587080 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.586976 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04aa2a02-0598-4f44-bf9c-8676c5121652-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.587707 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.587681 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04aa2a02-0598-4f44-bf9c-8676c5121652-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.600368 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.600348 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc69k\" (UniqueName: \"kubernetes.io/projected/04aa2a02-0598-4f44-bf9c-8676c5121652-kube-api-access-fc69k\") pod \"payload-processing-7bbcb654f4-8h9mf\" (UID: \"04aa2a02-0598-4f44-bf9c-8676c5121652\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.682738 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.682711 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:47:59.728007 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.727971 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:47:59.865375 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.865347 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5ccdd78dd9-9wjss"] Jul 02 11:47:59.867347 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:47:59.867320 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbb5211_2350_473b_915c_71ead1ca7bb3.slice/crio-4bcd823b17208075f01529a14bed2bc5bc15a687a63c4380dc1d7aa7134e4e7e WatchSource:0}: Error finding container 4bcd823b17208075f01529a14bed2bc5bc15a687a63c4380dc1d7aa7134e4e7e: Status 404 returned error can't find the container with id 4bcd823b17208075f01529a14bed2bc5bc15a687a63c4380dc1d7aa7134e4e7e Jul 02 11:47:59.868830 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.868810 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 11:47:59.893479 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:47:59.893456 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8h9mf"] Jul 02 11:47:59.895236 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:47:59.895214 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04aa2a02_0598_4f44_bf9c_8676c5121652.slice/crio-d47ca2fd037a7da6351bf0622994644226c66465bd353c72db42376b685bff7a WatchSource:0}: Error finding container d47ca2fd037a7da6351bf0622994644226c66465bd353c72db42376b685bff7a: Status 404 returned error can't find the container with id d47ca2fd037a7da6351bf0622994644226c66465bd353c72db42376b685bff7a Jul 02 11:48:00.028711 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:00.028682 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" event={"ID":"3bbb5211-2350-473b-915c-71ead1ca7bb3","Type":"ContainerStarted","Data":"4bcd823b17208075f01529a14bed2bc5bc15a687a63c4380dc1d7aa7134e4e7e"} Jul 02 11:48:00.029849 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:00.029827 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerStarted","Data":"d47ca2fd037a7da6351bf0622994644226c66465bd353c72db42376b685bff7a"} Jul 02 11:48:03.047859 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.047777 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerStarted","Data":"40b1284e6d99c717bfe72164b6e168d923fa46b1d993e952ce48249ca87b177e"} Jul 02 11:48:03.048303 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.047867 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:48:03.049420 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.049396 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" event={"ID":"3bbb5211-2350-473b-915c-71ead1ca7bb3","Type":"ContainerStarted","Data":"842f62ca6fed401d400624e6e5027181d07b21e3e472656855ec46c0a5ae1fed"} Jul 02 11:48:03.049502 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.049478 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:48:03.067182 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.067145 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" podStartSLOduration=1.138347084 podStartE2EDuration="4.067132358s" totalImagesPullingTime="2.928785274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:48:03.065751373 +0000 UTC m=+646.759786498" watchObservedRunningTime="2026-07-02 11:48:03.067132358 +0000 UTC m=+646.761167483" Jul 02 11:48:03.086826 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:03.086783 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" podStartSLOduration=2.183577134 podStartE2EDuration="5.086759194s" totalImagesPullingTime="2.90318206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:48:03.084524278 +0000 UTC m=+646.778559405" watchObservedRunningTime="2026-07-02 11:48:03.086759194 +0000 UTC m=+646.780794318" Jul 02 11:48:09.060271 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:09.060225 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5ccdd78dd9-9wjss" Jul 02 11:48:10.628151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:10.628117 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:10.628562 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:10.628305 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" containerID="cri-o://890d396ed8762428aa480eedc86d6424cbbc11c3691bf48b18a8a9b004b81c33" gracePeriod=30 Jul 02 11:48:12.098605 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.098569 2551 generic.go:356] "Generic (PLEG): container finished" podID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerID="890d396ed8762428aa480eedc86d6424cbbc11c3691bf48b18a8a9b004b81c33" exitCode=143 Jul 02 11:48:12.098951 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.098631 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c8b4f53-d4c9-4b31-81ee-b661389ff09d","Type":"ContainerDied","Data":"890d396ed8762428aa480eedc86d6424cbbc11c3691bf48b18a8a9b004b81c33"} Jul 02 11:48:12.175475 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.175453 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:12.290995 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.290919 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mczrv\" (UniqueName: \"kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv\") pod \"1c8b4f53-d4c9-4b31-81ee-b661389ff09d\" (UID: \"1c8b4f53-d4c9-4b31-81ee-b661389ff09d\") " Jul 02 11:48:12.300295 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.300243 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv" (OuterVolumeSpecName: "kube-api-access-mczrv") pod "1c8b4f53-d4c9-4b31-81ee-b661389ff09d" (UID: "1c8b4f53-d4c9-4b31-81ee-b661389ff09d"). InnerVolumeSpecName "kube-api-access-mczrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:48:12.392176 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:12.392148 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mczrv\" (UniqueName: \"kubernetes.io/projected/1c8b4f53-d4c9-4b31-81ee-b661389ff09d-kube-api-access-mczrv\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:48:13.105225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.105149 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.105225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.105167 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1c8b4f53-d4c9-4b31-81ee-b661389ff09d","Type":"ContainerDied","Data":"2d61c8a437993cea3046e52f57d810704bfe7ddadc4c18de34d288e678327e08"} Jul 02 11:48:13.105225 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.105224 2551 scope.go:117] "RemoveContainer" containerID="890d396ed8762428aa480eedc86d6424cbbc11c3691bf48b18a8a9b004b81c33" Jul 02 11:48:13.123743 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.123712 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:13.128279 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.128244 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:13.151746 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.151726 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:13.152047 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.152036 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" Jul 02 11:48:13.152095 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.152050 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" Jul 02 11:48:13.152131 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.152109 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" containerName="keycloak" Jul 02 11:48:13.156354 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.156338 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.160481 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.160464 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-plmrx\"" Jul 02 11:48:13.160578 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.160518 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 11:48:13.160706 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.160686 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 11:48:13.160749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.160726 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 11:48:13.160749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.160726 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 11:48:13.165914 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.165894 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:13.167581 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.167556 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:13.263885 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.263859 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:13.300033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.300010 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z277m\" (UniqueName: \"kubernetes.io/projected/f6f13681-eebb-4801-bb8a-3a4b8e95f497-kube-api-access-z277m\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.300145 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.300040 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f6f13681-eebb-4801-bb8a-3a4b8e95f497-test-realms\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.401442 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.401377 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z277m\" (UniqueName: \"kubernetes.io/projected/f6f13681-eebb-4801-bb8a-3a4b8e95f497-kube-api-access-z277m\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.401442 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.401411 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f6f13681-eebb-4801-bb8a-3a4b8e95f497-test-realms\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.402047 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.402028 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f6f13681-eebb-4801-bb8a-3a4b8e95f497-test-realms\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.409812 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.409791 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z277m\" (UniqueName: \"kubernetes.io/projected/f6f13681-eebb-4801-bb8a-3a4b8e95f497-kube-api-access-z277m\") pod \"maas-keycloak-0\" (UID: \"f6f13681-eebb-4801-bb8a-3a4b8e95f497\") " pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.466626 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.466596 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:13.600261 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:13.600191 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 11:48:13.602927 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:48:13.602894 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f13681_eebb_4801_bb8a_3a4b8e95f497.slice/crio-ff4eea5566926d482cde3ed002b761d1158b461373944b0cb0d0324bb8843171 WatchSource:0}: Error finding container ff4eea5566926d482cde3ed002b761d1158b461373944b0cb0d0324bb8843171: Status 404 returned error can't find the container with id ff4eea5566926d482cde3ed002b761d1158b461373944b0cb0d0324bb8843171 Jul 02 11:48:14.056407 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:14.056382 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:48:14.112437 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:14.112407 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6f13681-eebb-4801-bb8a-3a4b8e95f497","Type":"ContainerStarted","Data":"ff4eea5566926d482cde3ed002b761d1158b461373944b0cb0d0324bb8843171"} Jul 02 11:48:14.819131 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:14.819095 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8b4f53-d4c9-4b31-81ee-b661389ff09d" path="/var/lib/kubelet/pods/1c8b4f53-d4c9-4b31-81ee-b661389ff09d/volumes" Jul 02 11:48:15.123988 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:15.123319 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6f13681-eebb-4801-bb8a-3a4b8e95f497","Type":"ContainerStarted","Data":"b6ade731cddb064b2867417bd70e0fc66bb5a8d4a817625ea4f8cdcd6d069ef4"} Jul 02 11:48:15.148030 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:15.147967 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6290870320000002 podStartE2EDuration="2.1479469s" totalImagesPullingTime="518.859868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:48:15.144431986 +0000 UTC m=+658.838467123" watchObservedRunningTime="2026-07-02 11:48:15.1479469 +0000 UTC m=+658.841982030" Jul 02 11:48:15.466917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:15.466807 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:15.468973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:15.468914 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:16.467817 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:16.467769 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:17.468010 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:17.467958 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:18.467878 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:18.467836 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:19.468459 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:19.467995 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:20.467724 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:20.467657 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:21.467833 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:21.467768 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:22.467764 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:22.467712 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:23.466807 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:23.466762 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:23.467333 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:23.467270 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:24.467973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:24.467924 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:25.468082 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:25.468037 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:26.467115 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:26.467057 2551 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.52:9000/health/started\": dial tcp 10.132.0.52:9000: connect: connection refused" Jul 02 11:48:27.584432 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:27.584381 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:27.598328 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:27.598286 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f6f13681-eebb-4801-bb8a-3a4b8e95f497" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 11:48:31.620775 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:31.620738 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:31.921186 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:31.921100 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:37.592009 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:37.591970 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 11:48:48.308184 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.308151 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:48:48.311828 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.311808 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.314570 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.314547 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 11:48:48.320589 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.320566 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:48:48.419657 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.419631 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.419791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.419665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxg6\" (UniqueName: \"kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.419791 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.419692 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.520293 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.520242 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.520425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.520360 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.520425 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.520386 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxg6\" (UniqueName: \"kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.520948 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.520922 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.522724 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.522706 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.529910 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.529889 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxg6\" (UniqueName: \"kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6\") pod \"authorino-7546dcc5bc-mvv7r\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.621867 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.621806 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:48:48.751969 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:48.751942 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:48:48.753516 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:48:48.753488 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddda03577_09d2_467b_b85d_9230a5f5b0e9.slice/crio-61b1157fe46886129b23a1fef06da2bb54aeed09797f4601c7a7469195211c63 WatchSource:0}: Error finding container 61b1157fe46886129b23a1fef06da2bb54aeed09797f4601c7a7469195211c63: Status 404 returned error can't find the container with id 61b1157fe46886129b23a1fef06da2bb54aeed09797f4601c7a7469195211c63 Jul 02 11:48:49.352592 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:49.352558 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" event={"ID":"dda03577-09d2-467b-b85d-9230a5f5b0e9","Type":"ContainerStarted","Data":"61b1157fe46886129b23a1fef06da2bb54aeed09797f4601c7a7469195211c63"} Jul 02 11:48:50.359697 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.359662 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" event={"ID":"dda03577-09d2-467b-b85d-9230a5f5b0e9","Type":"ContainerStarted","Data":"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a"} Jul 02 11:48:50.376716 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.376663 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" podStartSLOduration=1.7205396450000001 podStartE2EDuration="2.376644835s" totalImagesPullingTime="656.10519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:48:50.376029534 +0000 UTC m=+694.070064664" watchObservedRunningTime="2026-07-02 11:48:50.376644835 +0000 UTC m=+694.070679961" Jul 02 11:48:50.406936 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.406907 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:48:50.407103 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.407074 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" podUID="7a6f82d7-57e7-4345-934c-e266261c41d4" containerName="authorino" containerID="cri-o://36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf" gracePeriod=30 Jul 02 11:48:50.658796 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.658771 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:48:50.741105 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.741079 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cgjf\" (UniqueName: \"kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf\") pod \"7a6f82d7-57e7-4345-934c-e266261c41d4\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " Jul 02 11:48:50.741226 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.741172 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert\") pod \"7a6f82d7-57e7-4345-934c-e266261c41d4\" (UID: \"7a6f82d7-57e7-4345-934c-e266261c41d4\") " Jul 02 11:48:50.743067 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.743047 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf" (OuterVolumeSpecName: "kube-api-access-4cgjf") pod "7a6f82d7-57e7-4345-934c-e266261c41d4" (UID: "7a6f82d7-57e7-4345-934c-e266261c41d4"). InnerVolumeSpecName "kube-api-access-4cgjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:48:50.751203 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.751179 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a6f82d7-57e7-4345-934c-e266261c41d4" (UID: "7a6f82d7-57e7-4345-934c-e266261c41d4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:48:50.842306 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.842283 2551 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a6f82d7-57e7-4345-934c-e266261c41d4-tls-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:48:50.842386 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:50.842308 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cgjf\" (UniqueName: \"kubernetes.io/projected/7a6f82d7-57e7-4345-934c-e266261c41d4-kube-api-access-4cgjf\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:48:51.088577 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.088541 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:51.181749 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.181714 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:51.365810 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.365732 2551 generic.go:356] "Generic (PLEG): container finished" podID="7a6f82d7-57e7-4345-934c-e266261c41d4" containerID="36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf" exitCode=0 Jul 02 11:48:51.365810 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.365777 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" Jul 02 11:48:51.366200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.365818 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" event={"ID":"7a6f82d7-57e7-4345-934c-e266261c41d4","Type":"ContainerDied","Data":"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf"} Jul 02 11:48:51.366200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.365858 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69bf9f869f-6bdtx" event={"ID":"7a6f82d7-57e7-4345-934c-e266261c41d4","Type":"ContainerDied","Data":"d2d8dcb64ded237abf161ce4ec1417e725c93392cae81a54174d6e70863a4672"} Jul 02 11:48:51.366200 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.365878 2551 scope.go:117] "RemoveContainer" containerID="36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf" Jul 02 11:48:51.374775 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.374756 2551 scope.go:117] "RemoveContainer" containerID="36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf" Jul 02 11:48:51.375040 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:48:51.375021 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf\": container with ID starting with 36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf not found: ID does not exist" containerID="36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf" Jul 02 11:48:51.375085 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.375049 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf"} err="failed to get container status \"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf\": rpc error: code = NotFound desc = could not find container \"36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf\": container with ID starting with 36dc1491b1aa745bee21ff0bd45a1144fa2a66c7d8c5269c031ee135d3d995bf not found: ID does not exist" Jul 02 11:48:51.381579 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.381559 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:48:51.387648 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:51.387630 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69bf9f869f-6bdtx"] Jul 02 11:48:52.330002 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:52.329967 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:52.430290 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:52.430237 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:48:52.818040 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:48:52.818011 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6f82d7-57e7-4345-934c-e266261c41d4" path="/var/lib/kubelet/pods/7a6f82d7-57e7-4345-934c-e266261c41d4/volumes" Jul 02 11:49:15.957534 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:15.957499 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:16.058492 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:16.058460 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:16.202477 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:16.202440 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:21.368898 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:21.368859 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:27.951653 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.951611 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk"] Jul 02 11:49:27.952214 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.952102 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6f82d7-57e7-4345-934c-e266261c41d4" containerName="authorino" Jul 02 11:49:27.952214 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.952123 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6f82d7-57e7-4345-934c-e266261c41d4" containerName="authorino" Jul 02 11:49:27.952377 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.952234 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6f82d7-57e7-4345-934c-e266261c41d4" containerName="authorino" Jul 02 11:49:27.956717 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.956695 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:27.959455 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.959435 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fdwbp\"" Jul 02 11:49:27.959568 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.959516 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 11:49:27.959640 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.959614 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 11:49:27.960464 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.960446 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 11:49:27.965790 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.965768 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk"] Jul 02 11:49:27.980978 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:27.980951 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:28.031042 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031012 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.031152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031052 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74da93d-c3de-4c20-befc-6d36519ade8c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.031152 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031079 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2gs\" (UniqueName: \"kubernetes.io/projected/d74da93d-c3de-4c20-befc-6d36519ade8c-kube-api-access-qb2gs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.031239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031163 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.031239 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031214 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.031385 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.031321 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131664 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131838 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131709 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131838 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131745 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131838 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131772 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131838 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131787 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74da93d-c3de-4c20-befc-6d36519ade8c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.131838 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.131808 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2gs\" (UniqueName: \"kubernetes.io/projected/d74da93d-c3de-4c20-befc-6d36519ade8c-kube-api-access-qb2gs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.132121 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.132097 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.132232 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.132203 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.132335 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.132278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.134050 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.134025 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74da93d-c3de-4c20-befc-6d36519ade8c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.134313 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.134298 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74da93d-c3de-4c20-befc-6d36519ade8c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.140488 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.140469 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2gs\" (UniqueName: \"kubernetes.io/projected/d74da93d-c3de-4c20-befc-6d36519ade8c-kube-api-access-qb2gs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vtnqk\" (UID: \"d74da93d-c3de-4c20-befc-6d36519ade8c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.267719 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.267648 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:28.399062 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.399037 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk"] Jul 02 11:49:28.400403 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:49:28.400374 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74da93d_c3de_4c20_befc_6d36519ade8c.slice/crio-2d2e74da9ee33138759d266de57af25b59b7e9e05d260c0b1a2c372d61a20b0c WatchSource:0}: Error finding container 2d2e74da9ee33138759d266de57af25b59b7e9e05d260c0b1a2c372d61a20b0c: Status 404 returned error can't find the container with id 2d2e74da9ee33138759d266de57af25b59b7e9e05d260c0b1a2c372d61a20b0c Jul 02 11:49:28.567661 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:28.567627 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" event={"ID":"d74da93d-c3de-4c20-befc-6d36519ade8c","Type":"ContainerStarted","Data":"2d2e74da9ee33138759d266de57af25b59b7e9e05d260c0b1a2c372d61a20b0c"} Jul 02 11:49:30.579744 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:30.579702 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" event={"ID":"d74da93d-c3de-4c20-befc-6d36519ade8c","Type":"ContainerStarted","Data":"46d3d7258e4260f51b161e15cbd02fa1cb46d76daa13b9e50df5cb277737cca8"} Jul 02 11:49:30.600573 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:30.600525 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" podStartSLOduration=2.4825057360000002 podStartE2EDuration="3.600513089s" totalImagesPullingTime="1.118007353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:49:30.596889948 +0000 UTC m=+734.290925101" watchObservedRunningTime="2026-07-02 11:49:30.600513089 +0000 UTC m=+734.294548213" Jul 02 11:49:37.191393 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:37.191357 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:38.268106 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:38.268072 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:38.268513 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:38.268138 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:38.280573 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:38.280551 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:38.630965 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:38.630937 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vtnqk" Jul 02 11:49:46.453316 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:46.453277 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:57.320780 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:57.320748 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:49:58.302119 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:49:58.302083 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:08.190216 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:08.190183 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:44.275965 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:44.275881 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:44.376327 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:44.376295 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:49.439631 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.439596 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f8678dddb-psxqt"] Jul 02 11:50:49.443107 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.443085 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.452335 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.452307 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8678dddb-psxqt"] Jul 02 11:50:49.479755 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.479712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4286b71-3f68-4345-a19f-8746d8b6d759-oidc-ca\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.479876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.479827 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4286b71-3f68-4345-a19f-8746d8b6d759-tls-cert\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.479876 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.479855 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qcj\" (UniqueName: \"kubernetes.io/projected/f4286b71-3f68-4345-a19f-8746d8b6d759-kube-api-access-b6qcj\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.580696 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.580661 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4286b71-3f68-4345-a19f-8746d8b6d759-tls-cert\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.580696 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.580703 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qcj\" (UniqueName: \"kubernetes.io/projected/f4286b71-3f68-4345-a19f-8746d8b6d759-kube-api-access-b6qcj\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.580837 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.580745 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4286b71-3f68-4345-a19f-8746d8b6d759-oidc-ca\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.581403 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.581384 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f4286b71-3f68-4345-a19f-8746d8b6d759-oidc-ca\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.583038 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.583019 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4286b71-3f68-4345-a19f-8746d8b6d759-tls-cert\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.588637 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.588611 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qcj\" (UniqueName: \"kubernetes.io/projected/f4286b71-3f68-4345-a19f-8746d8b6d759-kube-api-access-b6qcj\") pod \"authorino-7f8678dddb-psxqt\" (UID: \"f4286b71-3f68-4345-a19f-8746d8b6d759\") " pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.753189 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.753136 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8678dddb-psxqt" Jul 02 11:50:49.815975 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.815938 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:49.888389 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.888364 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8678dddb-psxqt"] Jul 02 11:50:49.890062 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:50:49.890037 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4286b71_3f68_4345_a19f_8746d8b6d759.slice/crio-cb49c57962a6a74955633165cab291c3fec37084b8001f634bad3d1bf4a36a83 WatchSource:0}: Error finding container cb49c57962a6a74955633165cab291c3fec37084b8001f634bad3d1bf4a36a83: Status 404 returned error can't find the container with id cb49c57962a6a74955633165cab291c3fec37084b8001f634bad3d1bf4a36a83 Jul 02 11:50:49.893611 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.893582 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:49.997676 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:49.997651 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8678dddb-psxqt" event={"ID":"f4286b71-3f68-4345-a19f-8746d8b6d759","Type":"ContainerStarted","Data":"cb49c57962a6a74955633165cab291c3fec37084b8001f634bad3d1bf4a36a83"} Jul 02 11:50:50.989630 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:50.989586 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:51.007700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.007651 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8678dddb-psxqt" event={"ID":"f4286b71-3f68-4345-a19f-8746d8b6d759","Type":"ContainerStarted","Data":"ea0d832f8b91d2d576c428924c1d8b663ead2f14347b8eb862a9066c1d89ed35"} Jul 02 11:50:51.031079 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.031015 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f8678dddb-psxqt" podStartSLOduration=1.645007667 podStartE2EDuration="2.030993663s" totalImagesPullingTime="385.985996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 11:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:50:51.027298446 +0000 UTC m=+814.721333573" watchObservedRunningTime="2026-07-02 11:50:51.030993663 +0000 UTC m=+814.725028790" Jul 02 11:50:51.067008 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.066958 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:50:51.067483 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.067446 2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" podUID="dda03577-09d2-467b-b85d-9230a5f5b0e9" containerName="authorino" containerID="cri-o://fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a" gracePeriod=30 Jul 02 11:50:51.102014 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.101966 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:50:51.336264 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.336228 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:50:51.411106 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.411074 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert\") pod \"dda03577-09d2-467b-b85d-9230a5f5b0e9\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " Jul 02 11:50:51.411295 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.411117 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlxg6\" (UniqueName: \"kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6\") pod \"dda03577-09d2-467b-b85d-9230a5f5b0e9\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " Jul 02 11:50:51.411295 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.411170 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca\") pod \"dda03577-09d2-467b-b85d-9230a5f5b0e9\" (UID: \"dda03577-09d2-467b-b85d-9230a5f5b0e9\") " Jul 02 11:50:51.413222 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.413186 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6" (OuterVolumeSpecName: "kube-api-access-wlxg6") pod "dda03577-09d2-467b-b85d-9230a5f5b0e9" (UID: "dda03577-09d2-467b-b85d-9230a5f5b0e9"). InnerVolumeSpecName "kube-api-access-wlxg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 11:50:51.415952 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.415926 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "dda03577-09d2-467b-b85d-9230a5f5b0e9" (UID: "dda03577-09d2-467b-b85d-9230a5f5b0e9"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 11:50:51.422466 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.422445 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dda03577-09d2-467b-b85d-9230a5f5b0e9" (UID: "dda03577-09d2-467b-b85d-9230a5f5b0e9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 11:50:51.512925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.512827 2551 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dda03577-09d2-467b-b85d-9230a5f5b0e9-tls-cert\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:50:51.512925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.512858 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlxg6\" (UniqueName: \"kubernetes.io/projected/dda03577-09d2-467b-b85d-9230a5f5b0e9-kube-api-access-wlxg6\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:50:51.512925 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:51.512871 2551 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dda03577-09d2-467b-b85d-9230a5f5b0e9-oidc-ca\") on node \"ip-10-0-134-102.ec2.internal\" DevicePath \"\"" Jul 02 11:50:52.016478 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.016432 2551 generic.go:356] "Generic (PLEG): container finished" podID="dda03577-09d2-467b-b85d-9230a5f5b0e9" containerID="fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a" exitCode=0 Jul 02 11:50:52.016973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.016511 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" Jul 02 11:50:52.016973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.016528 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" event={"ID":"dda03577-09d2-467b-b85d-9230a5f5b0e9","Type":"ContainerDied","Data":"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a"} Jul 02 11:50:52.016973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.016573 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7546dcc5bc-mvv7r" event={"ID":"dda03577-09d2-467b-b85d-9230a5f5b0e9","Type":"ContainerDied","Data":"61b1157fe46886129b23a1fef06da2bb54aeed09797f4601c7a7469195211c63"} Jul 02 11:50:52.016973 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.016593 2551 scope.go:117] "RemoveContainer" containerID="fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a" Jul 02 11:50:52.025872 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.025852 2551 scope.go:117] "RemoveContainer" containerID="fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a" Jul 02 11:50:52.026117 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:50:52.026098 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a\": container with ID starting with fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a not found: ID does not exist" containerID="fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a" Jul 02 11:50:52.026196 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.026125 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a"} err="failed to get container status \"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a\": rpc error: code = NotFound desc = could not find container \"fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a\": container with ID starting with fbeb82e4268d6b519fd216e255c6dd5bcde18a0c3e5f83ba339dc76c1d15c54a not found: ID does not exist" Jul 02 11:50:52.052098 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.052063 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:50:52.071188 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.071160 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7546dcc5bc-mvv7r"] Jul 02 11:50:52.818711 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:52.818675 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda03577-09d2-467b-b85d-9230a5f5b0e9" path="/var/lib/kubelet/pods/dda03577-09d2-467b-b85d-9230a5f5b0e9/volumes" Jul 02 11:50:57.047284 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:57.047239 2551 generic.go:356] "Generic (PLEG): container finished" podID="04aa2a02-0598-4f44-bf9c-8676c5121652" containerID="40b1284e6d99c717bfe72164b6e168d923fa46b1d993e952ce48249ca87b177e" exitCode=2 Jul 02 11:50:57.047700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:57.047312 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerDied","Data":"40b1284e6d99c717bfe72164b6e168d923fa46b1d993e952ce48249ca87b177e"} Jul 02 11:50:57.047700 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:57.047636 2551 scope.go:117] "RemoveContainer" containerID="40b1284e6d99c717bfe72164b6e168d923fa46b1d993e952ce48249ca87b177e" Jul 02 11:50:58.054138 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:58.054103 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerStarted","Data":"42c5748a1411a7bb42d0bd07b68d2c12d59391786d3bc317ae4a9ef34f8d7b18"} Jul 02 11:50:58.054567 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:50:58.054336 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:51:09.062119 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:09.062084 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:51:29.061026 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.060983 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" podUID="04aa2a02-0598-4f44-bf9c-8676c5121652" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.51:9004: connect: connection refused" Jul 02 11:51:29.217595 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.217513 2551 generic.go:356] "Generic (PLEG): container finished" podID="04aa2a02-0598-4f44-bf9c-8676c5121652" containerID="42c5748a1411a7bb42d0bd07b68d2c12d59391786d3bc317ae4a9ef34f8d7b18" exitCode=2 Jul 02 11:51:29.217595 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.217576 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerDied","Data":"42c5748a1411a7bb42d0bd07b68d2c12d59391786d3bc317ae4a9ef34f8d7b18"} Jul 02 11:51:29.217787 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.217623 2551 scope.go:117] "RemoveContainer" containerID="40b1284e6d99c717bfe72164b6e168d923fa46b1d993e952ce48249ca87b177e" Jul 02 11:51:29.217932 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.217907 2551 scope.go:117] "RemoveContainer" containerID="42c5748a1411a7bb42d0bd07b68d2c12d59391786d3bc317ae4a9ef34f8d7b18" Jul 02 11:51:29.218133 ip-10-0-134-102 kubenswrapper[2551]: E0702 11:51:29.218111 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-8h9mf_openshift-ingress(04aa2a02-0598-4f44-bf9c-8676c5121652)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" podUID="04aa2a02-0598-4f44-bf9c-8676c5121652" Jul 02 11:51:29.323261 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:29.323218 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8678dddb-psxqt_f4286b71-3f68-4345-a19f-8746d8b6d759/authorino/0.log" Jul 02 11:51:34.079814 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:34.079784 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5ccdd78dd9-9wjss_3bbb5211-2350-473b-915c-71ead1ca7bb3/maas-api/0.log" Jul 02 11:51:34.211534 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:34.211505 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4b7f5c49-t58dp_0a1b665f-2395-43bd-ae84-d70a17ce48de/manager/0.log" Jul 02 11:51:34.582656 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:34.582633 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c456b6-8d8h5_b136a8c9-413a-42c6-a521-a7208852046e/copy-manifests/0.log" Jul 02 11:51:34.591493 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:34.591464 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c456b6-8d8h5_b136a8c9-413a-42c6-a521-a7208852046e/manager/0.log" Jul 02 11:51:35.747462 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.747432 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/util/0.log" Jul 02 11:51:35.754299 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.754273 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/pull/0.log" Jul 02 11:51:35.760653 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.760632 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/extract/0.log" Jul 02 11:51:35.878400 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.878378 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/util/0.log" Jul 02 11:51:35.885593 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.885569 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/pull/0.log" Jul 02 11:51:35.892266 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:35.892226 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/extract/0.log" Jul 02 11:51:36.001878 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.001819 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/util/0.log" Jul 02 11:51:36.010033 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.010009 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/pull/0.log" Jul 02 11:51:36.017268 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.017224 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/extract/0.log" Jul 02 11:51:36.127540 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.127509 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/util/0.log" Jul 02 11:51:36.134264 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.134229 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/pull/0.log" Jul 02 11:51:36.140950 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.140917 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/extract/0.log" Jul 02 11:51:36.265006 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:36.264934 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8678dddb-psxqt_f4286b71-3f68-4345-a19f-8746d8b6d759/authorino/0.log" Jul 02 11:51:37.437738 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:37.437699 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t2fc8_b0f66a32-8d6e-432e-8ec1-0d3544d552dc/istio-proxy/0.log" Jul 02 11:51:37.679739 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:37.679702 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f5f497c84-9lgnc_d64f9e23-37d4-42cc-a49f-f870b17876da/kube-auth-proxy/0.log" Jul 02 11:51:38.133822 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:38.133796 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/1.log" Jul 02 11:51:38.249779 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:38.249754 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fc79d95c-2vnl5_860ac98e-388c-47ce-a650-3517cab5b724/router/0.log" Jul 02 11:51:38.719775 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:38.719748 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vtnqk_d74da93d-c3de-4c20-befc-6d36519ade8c/main/0.log" Jul 02 11:51:39.060989 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:39.060962 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:51:39.061303 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:39.061282 2551 scope.go:117] "RemoveContainer" containerID="42c5748a1411a7bb42d0bd07b68d2c12d59391786d3bc317ae4a9ef34f8d7b18" Jul 02 11:51:39.275127 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:39.275093 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" event={"ID":"04aa2a02-0598-4f44-bf9c-8676c5121652","Type":"ContainerStarted","Data":"b825878b3cf8b2c2e16525ba987c992752d9eeb546dc27fb2d62866d1c5efd9c"} Jul 02 11:51:39.275316 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:39.275297 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:51:43.003787 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:43.003746 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:51:43.103541 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:43.103511 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" limit=1024 Jul 02 11:51:45.989243 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:45.989211 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s6l45_e29da5ba-f670-4597-bae8-8be15b820916/global-pull-secret-syncer/0.log" Jul 02 11:51:46.040360 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:46.040336 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dfwwd_e14d2846-31ec-44d9-946c-07a3c0a394c6/konnectivity-agent/0.log" Jul 02 11:51:46.152149 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:46.152126 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-102.ec2.internal_67cd314639f46c104191661c02cd9b02/haproxy/0.log" Jul 02 11:51:50.282334 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.282301 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8h9mf" Jul 02 11:51:50.330421 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.330380 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/extract/0.log" Jul 02 11:51:50.371763 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.371734 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/util/0.log" Jul 02 11:51:50.397943 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.397918 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7t5p_b63fff58-0044-426a-b227-6e7225fd49fb/pull/0.log" Jul 02 11:51:50.429329 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.429307 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/extract/0.log" Jul 02 11:51:50.451064 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.451044 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/util/0.log" Jul 02 11:51:50.472292 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.472266 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qh7q8_97072bbf-1851-4a57-b60b-44c4ab459948/pull/0.log" Jul 02 11:51:50.507566 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.507545 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/extract/0.log" Jul 02 11:51:50.539696 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.539635 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/util/0.log" Jul 02 11:51:50.563546 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.563531 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73742ft_1f0f14c7-6c18-426b-be5e-54358ec16fdd/pull/0.log" Jul 02 11:51:50.592238 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.592217 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/extract/0.log" Jul 02 11:51:50.614873 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.614852 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/util/0.log" Jul 02 11:51:50.646636 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.646619 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15bjvr_0e54a2f4-3145-403a-9d6c-8f31d9fecb25/pull/0.log" Jul 02 11:51:50.695533 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:50.695511 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8678dddb-psxqt_f4286b71-3f68-4345-a19f-8746d8b6d759/authorino/0.log" Jul 02 11:51:52.767085 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:52.767054 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-r9cpj_f8251277-aebb-44c6-b196-a028cdbf71c7/cluster-monitoring-operator/0.log" Jul 02 11:51:52.994846 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:52.994813 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h988x_0aa8df69-8765-449e-8047-b15f5311daa8/node-exporter/0.log" Jul 02 11:51:53.058037 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:53.058018 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h988x_0aa8df69-8765-449e-8047-b15f5311daa8/kube-rbac-proxy/0.log" Jul 02 11:51:53.131452 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:53.131431 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h988x_0aa8df69-8765-449e-8047-b15f5311daa8/init-textfile/0.log" Jul 02 11:51:55.065077 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.065046 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-bzw2n_f0251feb-74c9-45ab-b815-2e4179d5c676/networking-console-plugin/0.log" Jul 02 11:51:55.690690 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.690663 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/1.log" Jul 02 11:51:55.700835 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.700811 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-76kv9_b11e0478-863b-42a6-ba31-25780b9a6a15/console-operator/2.log" Jul 02 11:51:55.960361 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.960295 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt"] Jul 02 11:51:55.960651 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.960640 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda03577-09d2-467b-b85d-9230a5f5b0e9" containerName="authorino" Jul 02 11:51:55.960703 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.960653 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda03577-09d2-467b-b85d-9230a5f5b0e9" containerName="authorino" Jul 02 11:51:55.960740 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.960707 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda03577-09d2-467b-b85d-9230a5f5b0e9" containerName="authorino" Jul 02 11:51:55.963827 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.963811 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:55.966447 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.966423 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj29f\"/\"kube-root-ca.crt\"" Jul 02 11:51:55.966576 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.966473 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj29f\"/\"openshift-service-ca.crt\"" Jul 02 11:51:55.967383 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.967368 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sj29f\"/\"default-dockercfg-vsm7m\"" Jul 02 11:51:55.973673 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:55.973654 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt"] Jul 02 11:51:56.029594 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.029568 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-podres\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.029747 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.029603 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-sys\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.029747 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.029625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttl2z\" (UniqueName: \"kubernetes.io/projected/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-kube-api-access-ttl2z\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.029747 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.029642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-proc\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.029747 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.029712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-lib-modules\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.130995 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.130956 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-proc\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.130995 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131004 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-lib-modules\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131076 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-podres\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131100 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-sys\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131076 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-proc\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131121 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttl2z\" (UniqueName: \"kubernetes.io/projected/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-kube-api-access-ttl2z\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131167 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-lib-modules\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131180 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-sys\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.131458 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.131185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-podres\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.141317 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.141290 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttl2z\" (UniqueName: \"kubernetes.io/projected/3eef351a-7867-45ab-8ef8-dc8cd6fdc170-kube-api-access-ttl2z\") pod \"perf-node-gather-daemonset-gqbzt\" (UID: \"3eef351a-7867-45ab-8ef8-dc8cd6fdc170\") " pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.274115 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.274085 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:56.308151 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.308124 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bd9fc5d79-wtjlk_edad8e4c-a0a4-4475-8102-b6cef44d0750/console/0.log" Jul 02 11:51:56.354777 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.354748 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-b9qnx_45956546-1df3-4886-ba86-335655448d2a/download-server/0.log" Jul 02 11:51:56.420999 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.420976 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt"] Jul 02 11:51:56.421987 ip-10-0-134-102 kubenswrapper[2551]: W0702 11:51:56.421959 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3eef351a_7867_45ab_8ef8_dc8cd6fdc170.slice/crio-81394b6d865e6e5f1a7ae30ea1bb00dbdb31b6343b6c97f8fe781821664121a6 WatchSource:0}: Error finding container 81394b6d865e6e5f1a7ae30ea1bb00dbdb31b6343b6c97f8fe781821664121a6: Status 404 returned error can't find the container with id 81394b6d865e6e5f1a7ae30ea1bb00dbdb31b6343b6c97f8fe781821664121a6 Jul 02 11:51:56.987455 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:56.987421 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-kxvll_62f7160a-badd-4f23-b2a9-a0d88d6558ad/volume-data-source-validator/0.log" Jul 02 11:51:57.373036 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:57.373003 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" event={"ID":"3eef351a-7867-45ab-8ef8-dc8cd6fdc170","Type":"ContainerStarted","Data":"3ac95b7aa4c6d3e36d3244976cab8a098738c7f0fa4beb6cb3ea5139540ab367"} Jul 02 11:51:57.373443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:57.373052 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" event={"ID":"3eef351a-7867-45ab-8ef8-dc8cd6fdc170","Type":"ContainerStarted","Data":"81394b6d865e6e5f1a7ae30ea1bb00dbdb31b6343b6c97f8fe781821664121a6"} Jul 02 11:51:57.373443 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:57.373100 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:51:57.395082 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:57.395042 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" podStartSLOduration=2.39502955 podStartE2EDuration="2.39502955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 11:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 11:51:57.394055984 +0000 UTC m=+881.088091110" watchObservedRunningTime="2026-07-02 11:51:57.39502955 +0000 UTC m=+881.089064675" Jul 02 11:51:58.156368 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:58.156338 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nfnxc_50bbd704-2cf4-4d3a-98d2-1796f29114a2/dns/0.log" Jul 02 11:51:58.176416 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:58.176390 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nfnxc_50bbd704-2cf4-4d3a-98d2-1796f29114a2/kube-rbac-proxy/0.log" Jul 02 11:51:58.225902 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:58.225876 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjt77_75246532-adc3-4159-9287-424e7ce1f540/dns-node-resolver/0.log" Jul 02 11:51:58.841570 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:58.841544 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fktrt_a8741aaf-5c14-4b9f-a2f2-bf27a6fdb0bf/node-ca/0.log" Jul 02 11:51:59.837933 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:59.837902 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t2fc8_b0f66a32-8d6e-432e-8ec1-0d3544d552dc/istio-proxy/0.log" Jul 02 11:51:59.899452 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:51:59.899424 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f5f497c84-9lgnc_d64f9e23-37d4-42cc-a49f-f870b17876da/kube-auth-proxy/0.log" Jul 02 11:52:00.001623 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:00.001593 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/2.log" Jul 02 11:52:00.002691 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:00.002672 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/1.log" Jul 02 11:52:00.028474 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:00.028449 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fc79d95c-2vnl5_860ac98e-388c-47ce-a650-3517cab5b724/router/0.log" Jul 02 11:52:00.740982 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:00.740955 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-st69p_afbdf298-77c1-4209-b8bd-89ccf168aac3/serve-healthcheck-canary/0.log" Jul 02 11:52:01.194163 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:01.194134 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-dgzqf_c9249aee-3e1f-4e45-81ed-a6bb8f6a158c/insights-operator/1.log" Jul 02 11:52:01.208400 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:01.208377 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-dgzqf_c9249aee-3e1f-4e45-81ed-a6bb8f6a158c/insights-operator/0.log" Jul 02 11:52:01.301311 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:01.301282 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skw6v_9b6589c8-d42f-43a0-b32c-76191c220627/kube-rbac-proxy/0.log" Jul 02 11:52:01.321320 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:01.321301 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skw6v_9b6589c8-d42f-43a0-b32c-76191c220627/exporter/0.log" Jul 02 11:52:01.341979 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:01.341959 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skw6v_9b6589c8-d42f-43a0-b32c-76191c220627/extractor/0.log" Jul 02 11:52:03.388489 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:03.388458 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sj29f/perf-node-gather-daemonset-gqbzt" Jul 02 11:52:03.709917 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:03.709839 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5ccdd78dd9-9wjss_3bbb5211-2350-473b-915c-71ead1ca7bb3/maas-api/0.log" Jul 02 11:52:03.747862 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:03.747838 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4b7f5c49-t58dp_0a1b665f-2395-43bd-ae84-d70a17ce48de/manager/0.log" Jul 02 11:52:03.872379 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:03.872343 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c456b6-8d8h5_b136a8c9-413a-42c6-a521-a7208852046e/manager/0.log" Jul 02 11:52:03.892864 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:03.892846 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c456b6-8d8h5_b136a8c9-413a-42c6-a521-a7208852046e/copy-manifests/0.log" Jul 02 11:52:05.657158 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:05.657130 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c9658df68-kh8x9_f60e9ec3-2ad0-4d1a-b048-d504fb41ed1e/manager/0.log" Jul 02 11:52:06.068054 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:06.068025 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t2fc8_b0f66a32-8d6e-432e-8ec1-0d3544d552dc/istio-proxy/0.log" Jul 02 11:52:06.117021 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:06.116996 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f5f497c84-9lgnc_d64f9e23-37d4-42cc-a49f-f870b17876da/kube-auth-proxy/0.log" Jul 02 11:52:06.188877 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:06.188806 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/2.log" Jul 02 11:52:06.189825 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:06.189806 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/1.log" Jul 02 11:52:06.202275 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:06.202240 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fc79d95c-2vnl5_860ac98e-388c-47ce-a650-3517cab5b724/router/0.log" Jul 02 11:52:07.232001 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:07.231972 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4t2fc8_b0f66a32-8d6e-432e-8ec1-0d3544d552dc/istio-proxy/0.log" Jul 02 11:52:07.279263 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:07.279221 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f5f497c84-9lgnc_d64f9e23-37d4-42cc-a49f-f870b17876da/kube-auth-proxy/0.log" Jul 02 11:52:07.452242 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:07.452158 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/2.log" Jul 02 11:52:07.452761 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:07.452732 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8h9mf_04aa2a02-0598-4f44-bf9c-8676c5121652/payload-processing/1.log" Jul 02 11:52:07.478514 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:07.478495 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79fc79d95c-2vnl5_860ac98e-388c-47ce-a650-3517cab5b724/router/0.log" Jul 02 11:52:11.068121 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:11.068031 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-flkdv_b8854ed4-6b8f-43b4-8534-a1b04f20a952/kube-storage-version-migrator-operator/1.log" Jul 02 11:52:11.069652 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:11.069625 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-flkdv_b8854ed4-6b8f-43b4-8534-a1b04f20a952/kube-storage-version-migrator-operator/0.log" Jul 02 11:52:12.092320 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.092289 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-99h8m_d695493a-259d-42cd-adc7-e70cfa7249d8/kube-multus/0.log" Jul 02 11:52:12.117381 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.117355 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/kube-multus-additional-cni-plugins/0.log" Jul 02 11:52:12.137037 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.137016 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/egress-router-binary-copy/0.log" Jul 02 11:52:12.156944 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.156924 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/cni-plugins/0.log" Jul 02 11:52:12.178906 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.178889 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/bond-cni-plugin/0.log" Jul 02 11:52:12.202223 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.202189 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/routeoverride-cni/0.log" Jul 02 11:52:12.224384 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.224367 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/whereabouts-cni-bincopy/0.log" Jul 02 11:52:12.245918 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.245902 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-46qn8_39ffdf1b-e9ed-46e8-904c-6a374390f553/whereabouts-cni/0.log" Jul 02 11:52:12.688179 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.688145 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glt4f_80c775cb-50d6-42d4-a9f5-3382b6d9f094/network-metrics-daemon/0.log" Jul 02 11:52:12.704621 ip-10-0-134-102 kubenswrapper[2551]: I0702 11:52:12.704596 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glt4f_80c775cb-50d6-42d4-a9f5-3382b6d9f094/kube-rbac-proxy/0.log"