Jul 10 02:14:00.811980 ip-10-0-143-3 systemd[1]: Starting Kubernetes Kubelet... Jul 10 02:14:01.263028 ip-10-0-143-3 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 02:14:01.263028 ip-10-0-143-3 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 02:14:01.263028 ip-10-0-143-3 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 02:14:01.263028 ip-10-0-143-3 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 02:14:01.263028 ip-10-0-143-3 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 02:14:01.266077 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.265935 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 02:14:01.274338 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274318 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.274338 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274336 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.274338 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274341 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274346 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274350 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274354 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274358 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274363 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274369 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274375 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274381 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274387 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274392 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274397 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274401 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274422 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274426 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274430 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274434 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274438 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274443 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.274528 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274447 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274451 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274455 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274460 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274465 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274478 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274482 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274486 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274491 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274495 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274501 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274505 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274509 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274513 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274518 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274523 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274527 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274531 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274535 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274540 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.275309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274544 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274548 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274553 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274557 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274561 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274566 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274570 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274575 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274580 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274584 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274588 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274592 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274599 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274605 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274610 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274615 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274619 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274624 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274628 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274633 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.276201 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274637 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274642 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274665 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274670 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274674 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274679 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274683 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274688 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274693 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274698 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274704 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274708 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274712 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274716 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274720 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274725 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274729 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274734 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274738 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274742 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.277023 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274747 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274751 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274756 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274760 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274764 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274768 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274771 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274777 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274781 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274785 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274791 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274795 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274799 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274804 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274808 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274812 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274817 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.274821 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276008 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276021 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.277838 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276026 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276031 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276035 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276039 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276044 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276048 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276052 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276057 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276061 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276066 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276070 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276074 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276078 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276083 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276088 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276092 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276096 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276101 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276105 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.278348 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276113 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276118 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276123 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276128 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276133 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276138 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276145 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276150 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276154 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276158 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276163 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276167 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276174 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276179 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276184 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276189 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276193 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276197 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276201 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276207 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.278826 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276211 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276215 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276219 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276223 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276227 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276231 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276235 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276240 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276244 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276249 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276252 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276257 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276261 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276265 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276269 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276273 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276277 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276283 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276287 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276291 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.279341 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276295 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276299 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276303 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276307 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276313 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276317 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276324 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276329 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276334 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276339 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276343 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276348 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276352 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276358 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276362 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276366 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276371 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276375 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276379 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.279855 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276383 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276388 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276392 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276396 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276400 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276404 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276408 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276412 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276416 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276420 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276425 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276429 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276433 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276439 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276444 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276449 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276453 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276458 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.276463 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278097 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.280308 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278111 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278115 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278118 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278121 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278124 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278127 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278130 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278133 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278136 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278140 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278142 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278145 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278148 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278151 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278153 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278156 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278158 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278161 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278164 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.280809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278166 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278169 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278171 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278175 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278177 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278180 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278182 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278185 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278187 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278190 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278192 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278195 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278198 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278202 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278204 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278206 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278209 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278212 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278214 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278217 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.281272 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278220 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278222 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278225 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278227 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278230 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278232 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278234 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278237 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278239 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278243 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278245 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278248 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278252 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278256 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278260 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278263 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278266 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278269 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278272 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.281779 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278274 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278277 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278280 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278283 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278285 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278288 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278292 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278295 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278298 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278300 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278303 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278306 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278308 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278312 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278316 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278319 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278322 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278325 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278328 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278330 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.282229 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278333 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278336 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278338 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278342 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278344 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278347 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278349 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278352 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278354 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278357 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278360 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278363 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278365 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278368 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278370 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278372 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278375 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278378 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278381 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.278385 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278464 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 02:14:01.282731 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278472 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278480 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278484 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278489 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278492 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278497 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278501 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278504 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278507 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278511 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278514 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278518 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278520 2567 flags.go:64] FLAG: --cgroup-root="" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278523 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278526 2567 flags.go:64] FLAG: --client-ca-file="" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278530 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278533 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278538 2567 flags.go:64] FLAG: --cluster-domain="" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278541 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278544 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278547 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278550 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278554 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 02:14:01.283330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278557 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278560 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278563 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278566 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278569 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278572 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278575 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278578 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278582 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278585 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278588 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278591 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278594 2567 flags.go:64] FLAG: --enable-server="true" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278596 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278602 2567 flags.go:64] FLAG: --event-burst="100" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278605 2567 flags.go:64] FLAG: --event-qps="50" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278607 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278611 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278614 2567 flags.go:64] FLAG: --eviction-hard="" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278618 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278621 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278623 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278626 2567 flags.go:64] FLAG: --eviction-soft="" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278629 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278632 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 02:14:01.283998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278635 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278639 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278642 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278644 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278663 2567 flags.go:64] FLAG: --feature-gates="" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278667 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278673 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278676 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278680 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278683 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278686 2567 flags.go:64] FLAG: --help="false" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278689 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278694 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278697 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278700 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278703 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278707 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278710 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278713 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278715 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278718 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278721 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278724 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278727 2567 flags.go:64] FLAG: --kube-reserved="" Jul 10 02:14:01.284603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278730 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278733 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278736 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278739 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278742 2567 flags.go:64] FLAG: --lock-file="" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278745 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278748 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278751 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278756 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278759 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278762 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278765 2567 flags.go:64] FLAG: --logging-format="text" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278768 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278771 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278777 2567 flags.go:64] FLAG: --manifest-url="" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278780 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278784 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278788 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278792 2567 flags.go:64] FLAG: --max-pods="110" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278795 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278800 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278803 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278806 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278809 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278811 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 02:14:01.285579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278814 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278823 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278826 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278829 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278832 2567 flags.go:64] FLAG: --pod-cidr="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278835 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278841 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278844 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278847 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278850 2567 flags.go:64] FLAG: --port="10250" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278853 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278856 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-067caf0ca334bb52a" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278859 2567 flags.go:64] FLAG: --qos-reserved="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278862 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278865 2567 flags.go:64] FLAG: --register-node="true" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278868 2567 flags.go:64] FLAG: --register-with-taints="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278872 2567 flags.go:64] FLAG: --registry-burst="10" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278877 2567 flags.go:64] FLAG: --registry-qps="5" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278879 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278882 2567 flags.go:64] FLAG: --reserved-memory="" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278886 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278889 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278893 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278896 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278898 2567 flags.go:64] FLAG: --runonce="false" Jul 10 02:14:01.286292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278901 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278904 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278908 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278911 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278914 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278917 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278921 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278924 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278927 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278930 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278933 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278936 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278939 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278942 2567 flags.go:64] FLAG: --system-cgroups="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278944 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278950 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278953 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278955 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278959 2567 flags.go:64] FLAG: --tls-min-version="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278962 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278965 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278968 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278970 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278973 2567 flags.go:64] FLAG: --v="2" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278977 2567 flags.go:64] FLAG: --version="false" Jul 10 02:14:01.286957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278982 2567 flags.go:64] FLAG: --vmodule="" Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278986 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.278989 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279106 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279113 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279116 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279119 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279123 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279127 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279131 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279134 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279137 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279140 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279143 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279145 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279148 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279151 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279153 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279156 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279158 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.287559 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279161 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279163 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279166 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279168 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279170 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279173 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279175 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279178 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279180 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279183 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279185 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279187 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279190 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279193 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279195 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279198 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279203 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279206 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279209 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.288070 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279212 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279215 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279219 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279221 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279224 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279227 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279229 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279232 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279235 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279237 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279240 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279242 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279245 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279247 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279250 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279252 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279255 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279258 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279260 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279262 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.288527 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279265 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279267 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279270 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279273 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279275 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279277 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279280 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279283 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279285 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279289 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279291 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279294 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279296 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279304 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279308 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279311 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279313 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279316 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279319 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.289059 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279323 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279325 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279328 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279331 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279333 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279335 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279338 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279341 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279343 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279346 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279349 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279351 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279354 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279356 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279359 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279361 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279364 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279367 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279369 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279371 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.289504 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279374 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279377 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279381 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.279383 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.280172 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.287612 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.287630 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.287670 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.287677 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287748 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287753 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287757 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287761 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287764 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.290043 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287767 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287770 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287773 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287776 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287779 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287781 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287784 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287787 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287791 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287795 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287799 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287801 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287804 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287806 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287809 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287811 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287814 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287816 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287819 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287821 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.290394 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287824 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287826 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287829 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287832 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287840 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287843 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287846 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287848 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287851 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287854 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287858 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287862 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287864 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287867 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287870 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287872 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287875 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287877 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287880 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287882 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.290886 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287884 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287887 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287890 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287892 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287895 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287897 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287900 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287902 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287905 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287908 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287910 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287913 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287915 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287918 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287920 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287923 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287926 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287934 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287936 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287939 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.291359 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287941 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287944 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287946 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287949 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287951 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287954 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287958 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287961 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287964 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287967 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287970 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287972 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287975 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287978 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287981 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287983 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287986 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287988 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287991 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.291865 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287993 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287996 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.287998 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288000 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288003 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288005 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288008 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288010 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288013 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288016 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288019 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288022 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288025 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288027 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288030 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.292373 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.288035 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288169 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288173 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288176 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288179 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288181 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288183 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288186 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288188 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288191 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288195 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288198 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288201 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288204 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288207 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288209 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288212 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288214 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288217 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 02:14:01.292773 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288219 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288222 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288225 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288228 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288230 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288234 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288237 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288240 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288242 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288245 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288248 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288251 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288253 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288255 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288258 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288260 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288263 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288265 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288267 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 02:14:01.293231 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288270 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288272 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288275 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288277 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288279 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288282 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288284 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288287 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288289 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288292 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288294 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288296 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288299 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288301 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288304 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288306 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288309 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288311 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288315 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288318 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 02:14:01.293720 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288320 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288323 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288326 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288329 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288332 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288334 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288338 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288341 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288344 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288347 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288349 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288351 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288354 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288356 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288358 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288361 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288363 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288366 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288368 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 02:14:01.294197 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288370 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288373 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288375 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288378 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288380 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288383 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288385 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288388 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288390 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288392 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288395 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288398 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288401 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288403 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288406 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288409 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288412 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288416 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288419 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288422 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 02:14:01.294665 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288425 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288427 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:01.288430 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.288436 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.288577 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.291884 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.293568 2567 server.go:1019] "Starting client certificate rotation" Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.293693 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 02:14:01.295156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.293730 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 02:14:01.296466 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.296452 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 02:14:01.299815 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.299787 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 02:14:01.307901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.307876 2567 log.go:25] "Validated CRI v1 runtime API" Jul 10 02:14:01.312436 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.312410 2567 log.go:25] "Validated CRI v1 image API" Jul 10 02:14:01.314980 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.314963 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 02:14:01.319211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.319192 2567 fs.go:135] Filesystem UUIDs: map[11d9acf4-6dd4-434a-b336-d75839c82d1a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c517768d-aeee-48be-a460-a6f83eeacf13:/dev/nvme0n1p4] Jul 10 02:14:01.319272 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.319212 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 02:14:01.324779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.324666 2567 manager.go:216] Machine: {Timestamp:2026-07-10 02:14:01.323278335 +0000 UTC m=+0.383683512 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114312 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2741446392cd390adf1deeb652dc8d SystemUUID:ec274144-6392-cd39-0adf-1deeb652dc8d BootID:81b1e397-a36f-4e74-adae-e79ebe1ce21c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:82:1f:e1:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:82:1f:e1:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:d9:77:e8:1c:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 02:14:01.324779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.324769 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 02:14:01.324916 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.324846 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 02:14:01.325421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.325405 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 02:14:01.328380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.328349 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 02:14:01.328535 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.328384 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 02:14:01.329232 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.329218 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 02:14:01.329232 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.329231 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 02:14:01.329370 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.329239 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 02:14:01.330360 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.329907 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 02:14:01.331790 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.331777 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 02:14:01.336435 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336423 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 10 02:14:01.336546 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336537 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 02:14:01.336587 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336569 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 10 02:14:01.336624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336592 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 02:14:01.336624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336610 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 02:14:01.336624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336622 2567 kubelet.go:398] "Adding apiserver pod source" Jul 10 02:14:01.336738 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.336635 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 02:14:01.337016 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.337004 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 02:14:01.337054 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.337023 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 02:14:01.339481 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.339458 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 02:14:01.342071 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342058 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 02:14:01.342136 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342089 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 02:14:01.342241 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342232 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 02:14:01.342271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342247 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 02:14:01.342271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342253 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 02:14:01.342271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342260 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 02:14:01.342271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342267 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 02:14:01.342397 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342274 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 02:14:01.342907 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342895 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 02:14:01.342907 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342907 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 02:14:01.342977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342916 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 02:14:01.342977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342921 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 02:14:01.342977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342930 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 02:14:01.342977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.342938 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 02:14:01.343775 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.343766 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 02:14:01.343775 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.343775 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 02:14:01.347069 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.347054 2567 server.go:1268] "Started kubelet" Jul 10 02:14:01.347197 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.347153 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 02:14:01.347403 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.347160 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 02:14:01.347972 ip-10-0-143-3 systemd[1]: Started Kubernetes Kubelet. Jul 10 02:14:01.350471 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.350441 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 02:14:01.351340 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.351281 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 02:14:01.351531 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.351494 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 02:14:01.351769 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.351749 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 02:14:01.351988 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.351951 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 02:14:01.354025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.354009 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 10 02:14:01.355385 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.355365 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 02:14:01.357953 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.356838 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-3.ec2.internal.18c0cbe60c3e14f2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-3.ec2.internal,UID:ip-10-0-143-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-3.ec2.internal,},FirstTimestamp:2026-07-10 02:14:01.34702821 +0000 UTC m=+0.407433225,LastTimestamp:2026-07-10 02:14:01.34702821 +0000 UTC m=+0.407433225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-3.ec2.internal,}" Jul 10 02:14:01.360709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.360689 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 02:14:01.360709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.360703 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 02:14:01.360859 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.360827 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.361461 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361437 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 02:14:01.361549 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361439 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 02:14:01.361549 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361484 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 02:14:01.361694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361614 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 10 02:14:01.361694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361624 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 10 02:14:01.361807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361797 2567 factory.go:55] Registering systemd factory Jul 10 02:14:01.361851 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.361813 2567 factory.go:223] Registration of the systemd container factory successfully Jul 10 02:14:01.362036 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362026 2567 factory.go:153] Registering CRI-O factory Jul 10 02:14:01.362036 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362038 2567 factory.go:223] Registration of the crio container factory successfully Jul 10 02:14:01.362104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362075 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 02:14:01.362104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362094 2567 factory.go:103] Registering Raw factory Jul 10 02:14:01.362104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362104 2567 manager.go:1196] Started watching for new ooms in manager Jul 10 02:14:01.362624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.362608 2567 manager.go:349] Starting recovery of all containers Jul 10 02:14:01.365678 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.365603 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 02:14:01.365678 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.365665 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 02:14:01.370516 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.370312 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 02:14:01.374032 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.374017 2567 manager.go:354] Recovery completed Jul 10 02:14:01.374961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.374932 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-md4f9" Jul 10 02:14:01.378572 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.378553 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.381080 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381064 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.381143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381092 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.381143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381103 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.381705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381644 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 02:14:01.381705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381704 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 02:14:01.381838 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381720 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 10 02:14:01.381838 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.381692 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.382562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.382549 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.382620 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.382576 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.382620 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.382586 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.382910 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.382894 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-md4f9" Jul 10 02:14:01.383662 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.383582 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-3.ec2.internal.18c0cbe60e45a7ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-3.ec2.internal,UID:ip-10-0-143-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-3.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-3.ec2.internal,},FirstTimestamp:2026-07-10 02:14:01.381079039 +0000 UTC m=+0.441484054,LastTimestamp:2026-07-10 02:14:01.381079039 +0000 UTC m=+0.441484054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-3.ec2.internal,}" Jul 10 02:14:01.383879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.383867 2567 policy_none.go:49] "None policy: Start" Jul 10 02:14:01.383912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.383883 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 02:14:01.383912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.383893 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 02:14:01.385875 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.385863 2567 policy_none.go:47] "Start" Jul 10 02:14:01.422270 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422254 2567 manager.go:337] "Starting Device Plugin manager" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.422289 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422304 2567 server.go:87] "Starting device plugin registration server" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422555 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422568 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422671 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422763 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.422775 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.423304 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 02:14:01.445183 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.423358 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.466774 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.466743 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 02:14:01.466896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.466791 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 02:14:01.466896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.466813 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 02:14:01.466896 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.466850 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 02:14:01.469389 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.469371 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 02:14:01.523524 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.523429 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.524636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.524619 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.524770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.524674 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.524770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.524688 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.524770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.524717 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.534831 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.534810 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.534927 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.534837 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-3.ec2.internal\": node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.559009 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.558980 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.567428 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.567404 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal"] Jul 10 02:14:01.567516 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.567483 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.568488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.568472 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.568570 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.568505 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.568570 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.568515 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.571010 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.570995 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.571136 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571121 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.571193 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571157 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.571719 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571704 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.571799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571726 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.571799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571732 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.571799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571751 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.571799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571762 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.571799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.571768 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.574074 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.574058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.574137 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.574085 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 02:14:01.574876 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.574860 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientMemory" Jul 10 02:14:01.574936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.574892 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 02:14:01.574936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.574906 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeHasSufficientPID" Jul 10 02:14:01.595406 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.595384 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-3.ec2.internal\" not found" node="ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.599951 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.599936 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-3.ec2.internal\" not found" node="ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.659275 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.659230 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.664220 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.664201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382efa3740e7079392d47b760e702167-config\") pod \"kube-apiserver-proxy-ip-10-0-143-3.ec2.internal\" (UID: \"382efa3740e7079392d47b760e702167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.664318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.664232 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.664318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.664261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.759769 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.759736 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.765110 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382efa3740e7079392d47b760e702167-config\") pod \"kube-apiserver-proxy-ip-10-0-143-3.ec2.internal\" (UID: \"382efa3740e7079392d47b760e702167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.765184 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765164 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.765238 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765189 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382efa3740e7079392d47b760e702167-config\") pod \"kube-apiserver-proxy-ip-10-0-143-3.ec2.internal\" (UID: \"382efa3740e7079392d47b760e702167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.765238 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.765334 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.765334 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.765300 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47383da59210c19d0ffe6c754a0cf85d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal\" (UID: \"47383da59210c19d0ffe6c754a0cf85d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.860616 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.860537 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:01.897967 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.897937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.903328 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:01.903178 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:01.961471 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:01.961436 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:02.061886 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.061856 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:02.162376 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.162291 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-3.ec2.internal\" not found" Jul 10 02:14:02.184262 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.184239 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 02:14:02.261216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.261169 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" Jul 10 02:14:02.271025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.270997 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 02:14:02.272585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.272569 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" Jul 10 02:14:02.287206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.287185 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 02:14:02.292350 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.292321 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 02:14:02.292528 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.292509 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 02:14:02.337502 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.337464 2567 apiserver.go:52] "Watching apiserver" Jul 10 02:14:02.347455 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.347420 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 02:14:02.348450 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.348417 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj","openshift-cluster-node-tuning-operator/tuned-kmbbc","openshift-dns/node-resolver-qh9bh","openshift-network-operator/iptables-alerter-dmvz5","openshift-ovn-kubernetes/ovnkube-node-229w6","kube-system/global-pull-secret-syncer-9xgbk","kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal","openshift-image-registry/node-ca-d6msk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal","openshift-multus/multus-additional-cni-plugins-52dvb","openshift-multus/multus-d9fxp","openshift-multus/network-metrics-daemon-b4mjq","openshift-network-diagnostics/network-check-target-mctlk","kube-system/konnectivity-agent-6nsr4"] Jul 10 02:14:02.351173 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.351155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.353258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.353239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:02.353353 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.353311 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:02.354069 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354054 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 02:14:02.354197 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354180 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 02:14:02.354260 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354210 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.354318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354257 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.354318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354264 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rj5fp\"" Jul 10 02:14:02.354318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.354291 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 02:14:02.355526 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.355503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.357678 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.357641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.357961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.357886 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.357961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.357902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hc488\"" Jul 10 02:14:02.358311 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.358297 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.360003 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.359980 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 02:14:02.360070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.360002 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.360122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.360108 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.360122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.360114 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6nrd7\"" Jul 10 02:14:02.360585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.360568 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.362127 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.362088 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 02:14:02.362438 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.362419 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 02:14:02.362690 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.362674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.362767 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.362740 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363794 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363809 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363856 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363873 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363856 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bwtwv\"" Jul 10 02:14:02.363976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.363859 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 02:14:02.364741 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.364720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.367267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.367250 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.367398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.367381 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 02:14:02.367468 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.367411 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 02:14:02.367468 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.367450 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ft76h\"" Jul 10 02:14:02.369106 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66ea201a-bd90-4ef7-882b-445586187626-host-slash\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.369206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-systemd-units\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369364 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-kubelet-config\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.369364 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-dbus\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.369465 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.369465 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66ea201a-bd90-4ef7-882b-445586187626-iptables-alerter-script\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.369465 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369456 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 02:14:02.369616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-ovn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-node-log\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369518 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s5ghr\"" Jul 10 02:14:02.369616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-env-overrides\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8mn\" (UniqueName: \"kubernetes.io/projected/8f22b018-dfa4-418a-af81-656fd01c024f-kube-api-access-ld8mn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-system-cni-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-script-lib\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369750 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.369867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdq8\" (UniqueName: \"kubernetes.io/projected/75cbee37-71a5-4bb9-b29f-9874c3c1e358-kube-api-access-5tdq8\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-bin\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-netns\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369902 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369932 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9cr4\" (UniqueName: \"kubernetes.io/projected/66ea201a-bd90-4ef7-882b-445586187626-kube-api-access-p9cr4\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-kubelet\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.369989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-slash\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cnibin\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-os-release\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.370143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-etc-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-log-socket\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-binary-copy\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-tmp-dir\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hc2\" (UniqueName: \"kubernetes.io/projected/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-kube-api-access-b6hc2\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-var-lib-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-netd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370435 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-config\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f22b018-dfa4-418a-af81-656fd01c024f-ovn-node-metrics-cert\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-systemd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.370558 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.371088 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.370565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-hosts-file\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.371397 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.371379 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.373863 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.373841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.373982 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.373966 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.374045 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.374022 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.375060 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.374339 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gzzf9\"" Jul 10 02:14:02.375060 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.374538 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 02:14:02.376188 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.376169 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.376334 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.376318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5gp5x\"" Jul 10 02:14:02.376409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.376349 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 02:14:02.376576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.376561 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 02:14:02.376684 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.376620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 02:14:02.378523 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.378504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.378611 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.378521 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 02:14:02.378611 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.378562 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:02.378719 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.378608 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-thlhx\"" Jul 10 02:14:02.387342 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.387296 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 02:09:02 +0000 UTC" deadline="2028-04-03 12:33:14.2986112 +0000 UTC" Jul 10 02:14:02.387342 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.387340 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15202h19m11.911273161s" Jul 10 02:14:02.395223 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.395206 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 02:14:02.410921 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.410903 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n5jqj" Jul 10 02:14:02.420443 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.420384 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n5jqj" Jul 10 02:14:02.460067 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.460031 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382efa3740e7079392d47b760e702167.slice/crio-8d7d4525f3863ad042dc26c6d9e59d2948f57439572a7446ba977f91c5b8828e WatchSource:0}: Error finding container 8d7d4525f3863ad042dc26c6d9e59d2948f57439572a7446ba977f91c5b8828e: Status 404 returned error can't find the container with id 8d7d4525f3863ad042dc26c6d9e59d2948f57439572a7446ba977f91c5b8828e Jul 10 02:14:02.460688 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.460670 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47383da59210c19d0ffe6c754a0cf85d.slice/crio-04769643e69d690bd8586d2795ca8493d43934fc690ecfebcecd7e9c3b913840 WatchSource:0}: Error finding container 04769643e69d690bd8586d2795ca8493d43934fc690ecfebcecd7e9c3b913840: Status 404 returned error can't find the container with id 04769643e69d690bd8586d2795ca8493d43934fc690ecfebcecd7e9c3b913840 Jul 10 02:14:02.462321 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.462299 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 02:14:02.465449 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.465430 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 02:14:02.470666 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" event={"ID":"382efa3740e7079392d47b760e702167","Type":"ContainerStarted","Data":"8d7d4525f3863ad042dc26c6d9e59d2948f57439572a7446ba977f91c5b8828e"} Jul 10 02:14:02.470776 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-node-log\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.470871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-env-overrides\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.470871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8mn\" (UniqueName: \"kubernetes.io/projected/8f22b018-dfa4-418a-af81-656fd01c024f-kube-api-access-ld8mn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.470871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470828 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-node-log\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.470871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-modprobe-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.470871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-run\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-multus\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-os-release\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.470987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-bin\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-netns\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-kubelet\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cnibin\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.471112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-os-release\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-binary-copy\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-sys-fs\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysconfig\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-etc-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-log-socket\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471331 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-kubelet\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cnibin\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-env-overrides\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471421 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-etc-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471438 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-os-release\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471437 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-bin\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471458 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-log-socket\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471486 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-netns\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.471507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471336 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-run-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-tmp-dir\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471831 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hc2\" (UniqueName: \"kubernetes.io/projected/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-kube-api-access-b6hc2\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-socket-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e51de088-5c18-4515-bd39-a6a94b5fa19f-host\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.471943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-tuned\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-var-lib-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-netd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472170 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-tmp-dir\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f22b018-dfa4-418a-af81-656fd01c024f-ovn-node-metrics-cert\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lts7x\" (UniqueName: \"kubernetes.io/projected/d6108e8d-401e-44aa-9ce2-d001b0599385-kube-api-access-lts7x\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472243 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-socket-dir-parent\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-var-lib-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-kubelet\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472361 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-cni-netd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-systemd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.473680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472483 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-systemd\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-conf\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cni-binary-copy\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472553 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-binary-copy\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472620 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-conf-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66ea201a-bd90-4ef7-882b-445586187626-host-slash\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-registration-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thvd\" (UniqueName: \"kubernetes.io/projected/bcf852c2-86fb-4722-9284-97be57533c80-kube-api-access-5thvd\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472890 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472870 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66ea201a-bd90-4ef7-882b-445586187626-host-slash\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.472989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llf6m\" (UniqueName: \"kubernetes.io/projected/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-kube-api-access-llf6m\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-kubelet-config\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-dbus\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.474440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-agent-certs\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473213 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-kubelet-config\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473246 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80aedb91-0c17-4538-9075-8a912b1e9e0f-dbus\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-konnectivity-ca\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-lib-modules\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-netns\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-ovn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473701 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-system-cni-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473800 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-ovn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.473816 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.473895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75cbee37-71a5-4bb9-b29f-9874c3c1e358-system-cni-dir\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.475213 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.473922 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:02.97388368 +0000 UTC m=+2.034288684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:02.475795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475348 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.475795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e51de088-5c18-4515-bd39-a6a94b5fa19f-serviceca\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.475795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.474013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" event={"ID":"47383da59210c19d0ffe6c754a0cf85d","Type":"ContainerStarted","Data":"04769643e69d690bd8586d2795ca8493d43934fc690ecfebcecd7e9c3b913840"} Jul 10 02:14:02.475795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-var-lib-kubelet\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.475795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-etc-kubernetes\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.476048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-script-lib\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.476048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.475946 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.476048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdq8\" (UniqueName: \"kubernetes.io/projected/75cbee37-71a5-4bb9-b29f-9874c3c1e358-kube-api-access-5tdq8\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.476327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476305 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-script-lib\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.476404 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlx9\" (UniqueName: \"kubernetes.io/projected/e51de088-5c18-4515-bd39-a6a94b5fa19f-kube-api-access-ptlx9\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.476466 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-systemd\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.476466 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-tmp\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.476595 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9cr4\" (UniqueName: \"kubernetes.io/projected/66ea201a-bd90-4ef7-882b-445586187626-kube-api-access-p9cr4\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.476595 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-slash\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.476595 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476569 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-host-slash\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-kubernetes\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-k8s-cni-cncf-io\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476736 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhdc\" (UniqueName: \"kubernetes.io/projected/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-kube-api-access-lkhdc\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-daemon-config\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.476877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-config\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-device-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.477234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-etc-selinux\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.477234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.476978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-system-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.477234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-hosts-file\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.477234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477225 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-bin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477304 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-hosts-file\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477338 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f22b018-dfa4-418a-af81-656fd01c024f-ovn-node-metrics-cert\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-systemd-units\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477356 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-run-openvswitch\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-host\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477458 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f22b018-dfa4-418a-af81-656fd01c024f-systemd-units\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-multus-certs\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477518 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477538 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f22b018-dfa4-418a-af81-656fd01c024f-ovnkube-config\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-sys\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cnibin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-hostroot\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.477961 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.477686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66ea201a-bd90-4ef7-882b-445586187626-iptables-alerter-script\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.478409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.478016 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75cbee37-71a5-4bb9-b29f-9874c3c1e358-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.478409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.478164 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66ea201a-bd90-4ef7-882b-445586187626-iptables-alerter-script\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.494023 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.494000 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:02.494023 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.494025 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:02.494182 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.494036 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:02.494182 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.494089 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:02.994074683 +0000 UTC m=+2.054479700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:02.496261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.496239 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9cr4\" (UniqueName: \"kubernetes.io/projected/66ea201a-bd90-4ef7-882b-445586187626-kube-api-access-p9cr4\") pod \"iptables-alerter-dmvz5\" (UID: \"66ea201a-bd90-4ef7-882b-445586187626\") " pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.496847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.496830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hc2\" (UniqueName: \"kubernetes.io/projected/8e5c9be1-aaa3-4feb-8dba-c7395ea64e75-kube-api-access-b6hc2\") pod \"node-resolver-qh9bh\" (UID: \"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75\") " pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.498762 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.498743 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 02:14:02.501373 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.501346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8mn\" (UniqueName: \"kubernetes.io/projected/8f22b018-dfa4-418a-af81-656fd01c024f-kube-api-access-ld8mn\") pod \"ovnkube-node-229w6\" (UID: \"8f22b018-dfa4-418a-af81-656fd01c024f\") " pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.502860 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.502843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdq8\" (UniqueName: \"kubernetes.io/projected/75cbee37-71a5-4bb9-b29f-9874c3c1e358-kube-api-access-5tdq8\") pod \"multus-additional-cni-plugins-52dvb\" (UID: \"75cbee37-71a5-4bb9-b29f-9874c3c1e358\") " pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.578248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-tmp\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-kubernetes\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-k8s-cni-cncf-io\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhdc\" (UniqueName: \"kubernetes.io/projected/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-kube-api-access-lkhdc\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578372 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-k8s-cni-cncf-io\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578384 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-daemon-config\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-device-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578372 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-kubernetes\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-etc-selinux\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-system-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-bin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578548 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-device-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578581 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-system-cni-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578581 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-bin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578599 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-host\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-etc-selinux\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-multus-certs\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-host\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578712 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-multus-certs\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-sys\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578749 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cnibin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578789 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-sys\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-hostroot\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578808 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cnibin\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.578983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578822 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-hostroot\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-modprobe-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-run\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-multus\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578904 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-modprobe-d\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-os-release\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578941 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-run\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-sys-fs\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578954 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-cni-multus\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysconfig\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.578998 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-os-release\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-socket-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e51de088-5c18-4515-bd39-a6a94b5fa19f-host\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579049 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysconfig\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-tuned\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lts7x\" (UniqueName: \"kubernetes.io/projected/d6108e8d-401e-44aa-9ce2-d001b0599385-kube-api-access-lts7x\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579093 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e51de088-5c18-4515-bd39-a6a94b5fa19f-host\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.579822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579012 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-sys-fs\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-socket-dir-parent\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579129 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-socket-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-kubelet\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-conf\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579187 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-socket-dir-parent\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-var-lib-kubelet\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cni-binary-copy\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579266 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-conf-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.579278 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-registration-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thvd\" (UniqueName: \"kubernetes.io/projected/bcf852c2-86fb-4722-9284-97be57533c80-kube-api-access-5thvd\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579325 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-sysctl-conf\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.579333 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:03.079314694 +0000 UTC m=+2.139719707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llf6m\" (UniqueName: \"kubernetes.io/projected/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-kube-api-access-llf6m\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579368 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-conf-dir\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.580865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-agent-certs\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-konnectivity-ca\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579428 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6108e8d-401e-44aa-9ce2-d001b0599385-registration-dir\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-lib-modules\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-netns\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e51de088-5c18-4515-bd39-a6a94b5fa19f-serviceca\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-var-lib-kubelet\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-etc-kubernetes\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlx9\" (UniqueName: \"kubernetes.io/projected/e51de088-5c18-4515-bd39-a6a94b5fa19f-kube-api-access-ptlx9\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579606 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-lib-modules\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-systemd\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579674 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-systemd\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579713 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-multus-daemon-config\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579722 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-var-lib-kubelet\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579722 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-cni-binary-copy\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579767 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-etc-kubernetes\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579887 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-host-run-netns\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.579988 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e51de088-5c18-4515-bd39-a6a94b5fa19f-serviceca\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.581709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.580097 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-konnectivity-ca\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.582261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.581237 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-tmp\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.582261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.581788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a47d4a4-4b86-461a-8be3-37ad1a9aef04-agent-certs\") pod \"konnectivity-agent-6nsr4\" (UID: \"7a47d4a4-4b86-461a-8be3-37ad1a9aef04\") " pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.582261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.581958 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-etc-tuned\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.594401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.594377 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lts7x\" (UniqueName: \"kubernetes.io/projected/d6108e8d-401e-44aa-9ce2-d001b0599385-kube-api-access-lts7x\") pod \"aws-ebs-csi-driver-node-5vkjj\" (UID: \"d6108e8d-401e-44aa-9ce2-d001b0599385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.594546 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.594477 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thvd\" (UniqueName: \"kubernetes.io/projected/bcf852c2-86fb-4722-9284-97be57533c80-kube-api-access-5thvd\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:02.594706 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.594687 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llf6m\" (UniqueName: \"kubernetes.io/projected/6d3b5d3e-a44d-433a-ba2d-ac9d41684b76-kube-api-access-llf6m\") pod \"multus-d9fxp\" (UID: \"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76\") " pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.595637 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.595618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlx9\" (UniqueName: \"kubernetes.io/projected/e51de088-5c18-4515-bd39-a6a94b5fa19f-kube-api-access-ptlx9\") pod \"node-ca-d6msk\" (UID: \"e51de088-5c18-4515-bd39-a6a94b5fa19f\") " pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.595712 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.595622 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhdc\" (UniqueName: \"kubernetes.io/projected/03fdd584-433c-4118-9fc1-bf5eb6bf7d3e-kube-api-access-lkhdc\") pod \"tuned-kmbbc\" (UID: \"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e\") " pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.679820 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.679749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52dvb" Jul 10 02:14:02.686109 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.686087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qh9bh" Jul 10 02:14:02.690049 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.690025 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cbee37_71a5_4bb9_b29f_9874c3c1e358.slice/crio-d4b78642a4f15f72169850147ba7c70aa3f32bc4560b47c88c85ac413469931b WatchSource:0}: Error finding container d4b78642a4f15f72169850147ba7c70aa3f32bc4560b47c88c85ac413469931b: Status 404 returned error can't find the container with id d4b78642a4f15f72169850147ba7c70aa3f32bc4560b47c88c85ac413469931b Jul 10 02:14:02.695219 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.695197 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5c9be1_aaa3_4feb_8dba_c7395ea64e75.slice/crio-cd93b08c34c9ff4113c92ec87e27fae459ffd5f0442df3d63bbcae79d8a1b8a5 WatchSource:0}: Error finding container cd93b08c34c9ff4113c92ec87e27fae459ffd5f0442df3d63bbcae79d8a1b8a5: Status 404 returned error can't find the container with id cd93b08c34c9ff4113c92ec87e27fae459ffd5f0442df3d63bbcae79d8a1b8a5 Jul 10 02:14:02.704467 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.704448 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dmvz5" Jul 10 02:14:02.714662 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.714618 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ea201a_bd90_4ef7_882b_445586187626.slice/crio-d3c3e2a55929aada7cb6a776624514f9029ee2a39ba4c2acb6e1a66432a50945 WatchSource:0}: Error finding container d3c3e2a55929aada7cb6a776624514f9029ee2a39ba4c2acb6e1a66432a50945: Status 404 returned error can't find the container with id d3c3e2a55929aada7cb6a776624514f9029ee2a39ba4c2acb6e1a66432a50945 Jul 10 02:14:02.720496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.720477 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:02.726435 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.726397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:02.734593 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.734569 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a47d4a4_4b86_461a_8be3_37ad1a9aef04.slice/crio-fb90566ca8dea8356f111a94d42f28698f98c19b5f8e2dd114c0176fb77a6cca WatchSource:0}: Error finding container fb90566ca8dea8356f111a94d42f28698f98c19b5f8e2dd114c0176fb77a6cca: Status 404 returned error can't find the container with id fb90566ca8dea8356f111a94d42f28698f98c19b5f8e2dd114c0176fb77a6cca Jul 10 02:14:02.759258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.759232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6msk" Jul 10 02:14:02.768212 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.768176 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51de088_5c18_4515_bd39_a6a94b5fa19f.slice/crio-69510cf2d28042721765b1afe741b5a7292e20a95736150a0e6dbbcf07e388e7 WatchSource:0}: Error finding container 69510cf2d28042721765b1afe741b5a7292e20a95736150a0e6dbbcf07e388e7: Status 404 returned error can't find the container with id 69510cf2d28042721765b1afe741b5a7292e20a95736150a0e6dbbcf07e388e7 Jul 10 02:14:02.772718 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.772688 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" Jul 10 02:14:02.780205 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.780186 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fdd584_433c_4118_9fc1_bf5eb6bf7d3e.slice/crio-503ae1002321177a7c5a96113bd16076e7a73dccfbc8be001d390f94acbe6d1c WatchSource:0}: Error finding container 503ae1002321177a7c5a96113bd16076e7a73dccfbc8be001d390f94acbe6d1c: Status 404 returned error can't find the container with id 503ae1002321177a7c5a96113bd16076e7a73dccfbc8be001d390f94acbe6d1c Jul 10 02:14:02.783214 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.783198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" Jul 10 02:14:02.788439 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.788419 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d9fxp" Jul 10 02:14:02.792487 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.792467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6108e8d_401e_44aa_9ce2_d001b0599385.slice/crio-b2981a948591ef5592bf195cd9b73a4a80c66f49d36ee74a49ddd5695dd9b5c6 WatchSource:0}: Error finding container b2981a948591ef5592bf195cd9b73a4a80c66f49d36ee74a49ddd5695dd9b5c6: Status 404 returned error can't find the container with id b2981a948591ef5592bf195cd9b73a4a80c66f49d36ee74a49ddd5695dd9b5c6 Jul 10 02:14:02.796873 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:02.796852 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3b5d3e_a44d_433a_ba2d_ac9d41684b76.slice/crio-2fbe677b4fd98e0749057b43517f1c1b75054fb1822f74294cb3354489f8a02a WatchSource:0}: Error finding container 2fbe677b4fd98e0749057b43517f1c1b75054fb1822f74294cb3354489f8a02a: Status 404 returned error can't find the container with id 2fbe677b4fd98e0749057b43517f1c1b75054fb1822f74294cb3354489f8a02a Jul 10 02:14:02.982415 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:02.982332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:02.982553 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.982472 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:02.982553 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:02.982531 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:03.982516632 +0000 UTC m=+3.042921635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:03.082880 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.082848 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:03.083051 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.082905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:03.083051 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083034 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:03.083169 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083096 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:03.083169 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083120 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:03.083169 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083133 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:03.083169 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083139 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:04.083116638 +0000 UTC m=+3.143521655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:03.083354 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.083187 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:04.083171672 +0000 UTC m=+3.143576685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:03.424104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.423920 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:09:03 +0000 UTC" deadline="2028-03-22 07:15:47.890113856 +0000 UTC" Jul 10 02:14:03.424104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.423989 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14909h1m44.466128893s" Jul 10 02:14:03.500113 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.500003 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6msk" event={"ID":"e51de088-5c18-4515-bd39-a6a94b5fa19f","Type":"ContainerStarted","Data":"69510cf2d28042721765b1afe741b5a7292e20a95736150a0e6dbbcf07e388e7"} Jul 10 02:14:03.514238 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.514193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"9749920a9196f4372218121c6249ab6eb57b89b1964b3c0f16d5df637c92e86e"} Jul 10 02:14:03.538411 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.538366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dmvz5" event={"ID":"66ea201a-bd90-4ef7-882b-445586187626","Type":"ContainerStarted","Data":"d3c3e2a55929aada7cb6a776624514f9029ee2a39ba4c2acb6e1a66432a50945"} Jul 10 02:14:03.542557 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.542509 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" event={"ID":"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e","Type":"ContainerStarted","Data":"503ae1002321177a7c5a96113bd16076e7a73dccfbc8be001d390f94acbe6d1c"} Jul 10 02:14:03.545266 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.545237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6nsr4" event={"ID":"7a47d4a4-4b86-461a-8be3-37ad1a9aef04","Type":"ContainerStarted","Data":"fb90566ca8dea8356f111a94d42f28698f98c19b5f8e2dd114c0176fb77a6cca"} Jul 10 02:14:03.552513 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.552468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qh9bh" event={"ID":"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75","Type":"ContainerStarted","Data":"cd93b08c34c9ff4113c92ec87e27fae459ffd5f0442df3d63bbcae79d8a1b8a5"} Jul 10 02:14:03.562312 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.562245 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerStarted","Data":"d4b78642a4f15f72169850147ba7c70aa3f32bc4560b47c88c85ac413469931b"} Jul 10 02:14:03.566130 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.566102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d9fxp" event={"ID":"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76","Type":"ContainerStarted","Data":"2fbe677b4fd98e0749057b43517f1c1b75054fb1822f74294cb3354489f8a02a"} Jul 10 02:14:03.580327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.580294 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" event={"ID":"d6108e8d-401e-44aa-9ce2-d001b0599385","Type":"ContainerStarted","Data":"b2981a948591ef5592bf195cd9b73a4a80c66f49d36ee74a49ddd5695dd9b5c6"} Jul 10 02:14:03.814633 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.814535 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 02:14:03.991638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:03.991582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:03.991853 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.991832 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:03.991938 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:03.991913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:05.991890996 +0000 UTC m=+5.052296003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:04.092110 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.092021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:04.092285 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.092108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:04.092349 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092306 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:04.092349 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092331 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:04.092349 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092345 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:04.092514 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092406 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:06.092386985 +0000 UTC m=+5.152792015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:04.093106 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092860 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:04.093106 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.092921 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:06.092903844 +0000 UTC m=+5.153308848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:04.425291 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.425202 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:09:03 +0000 UTC" deadline="2028-01-01 23:09:23.41052366 +0000 UTC" Jul 10 02:14:04.425291 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.425248 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12980h55m18.985280954s" Jul 10 02:14:04.467777 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.467695 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:04.467948 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.467858 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:04.468505 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.468317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:04.468505 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.468424 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:04.468505 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:04.468485 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:04.468744 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:04.468549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:06.010437 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.010184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:06.010970 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.010510 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:06.010970 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.010589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:10.010568169 +0000 UTC m=+9.070973177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.111726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.111844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112043 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112067 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112081 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112148 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:10.112123726 +0000 UTC m=+9.172528731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112583 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:06.112725 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.112637 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:10.112620322 +0000 UTC m=+9.173025330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:06.467448 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.467341 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:06.467628 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.467494 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:06.467940 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.467921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:06.468057 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.468035 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:06.468126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:06.468096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:06.468201 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:06.468179 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:08.468029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:08.467989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:08.468029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:08.468016 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:08.468438 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:08.467989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:08.468438 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:08.468133 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:08.468438 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:08.468181 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:08.468438 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:08.468239 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:10.049960 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.049906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:10.050347 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.050073 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:10.050347 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.050140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:18.050122435 +0000 UTC m=+17.110527439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:10.151352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.151312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:10.151553 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.151396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:10.151553 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151464 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:10.151553 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151538 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:10.151553 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151549 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:18.151524591 +0000 UTC m=+17.211929602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:10.151846 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151558 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:10.151846 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151572 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:10.151846 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.151625 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:18.151606841 +0000 UTC m=+17.212011865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:10.467688 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.467598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:10.467688 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.467634 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:10.467688 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:10.467616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:10.467920 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.467769 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:10.467920 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.467808 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:10.467920 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:10.467871 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:12.468033 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:12.467930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:12.468480 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:12.468062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:12.468480 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:12.467930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:12.468480 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:12.467930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:12.468480 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:12.468204 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:12.468480 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:12.468284 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:14.467590 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:14.467557 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:14.467590 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:14.467577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:14.468051 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:14.467686 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:14.468051 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:14.467734 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:14.468051 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:14.467786 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:14.468051 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:14.467910 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:15.624591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:15.624555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" event={"ID":"382efa3740e7079392d47b760e702167","Type":"ContainerStarted","Data":"4ff03d26d220e813571e60cf939a48997eae28c36a766eb7f1e8f0a558a76261"} Jul 10 02:14:15.626409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:15.626365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" event={"ID":"03fdd584-433c-4118-9fc1-bf5eb6bf7d3e","Type":"ContainerStarted","Data":"7e9aa251f059144defb7b10b0d8c5343d9c81ae87ab8375b7f2d32913d836583"} Jul 10 02:14:15.658212 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:15.658154 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kmbbc" podStartSLOduration=1.3840055470000001 podStartE2EDuration="13.658138155s" totalImagesPullingTime="12.274132608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:15.657937137 +0000 UTC m=+14.718342161" watchObservedRunningTime="2026-07-10 02:14:15.658138155 +0000 UTC m=+14.718543180" Jul 10 02:14:15.658529 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:15.658502 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-3.ec2.internal" podStartSLOduration=12.658493395 podStartE2EDuration="12.658493395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:15.64148333 +0000 UTC m=+14.701888375" watchObservedRunningTime="2026-07-10 02:14:15.658493395 +0000 UTC m=+14.718898420" Jul 10 02:14:16.467642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.467602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:16.467642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.467642 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:16.467877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.467607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:16.467877 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:16.467739 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:16.467877 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:16.467839 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:16.468029 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:16.467954 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:16.631102 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.631008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" event={"ID":"d6108e8d-401e-44aa-9ce2-d001b0599385","Type":"ContainerStarted","Data":"f137b6205c3fb9791a7b6597bcb5e67fb32fcaeb6eb148e52bea21f54e6e510e"} Jul 10 02:14:16.636461 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.636419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6msk" event={"ID":"e51de088-5c18-4515-bd39-a6a94b5fa19f","Type":"ContainerStarted","Data":"c40902e4b32fcd9caf9dc1570e6f2234dbc664dc510afb6db6872b6068f05b43"} Jul 10 02:14:16.638391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.638360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dmvz5" event={"ID":"66ea201a-bd90-4ef7-882b-445586187626","Type":"ContainerStarted","Data":"9ff2129474bbfa0df8e9d6b7d6c40db165be6da34ccf56decae8a7f931c53b00"} Jul 10 02:14:16.640188 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.640165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6nsr4" event={"ID":"7a47d4a4-4b86-461a-8be3-37ad1a9aef04","Type":"ContainerStarted","Data":"3e7a43684ebe9fc558e132415d5ef46299898b6e0d0ef589fcbcab75cf4a6ce5"} Jul 10 02:14:16.642172 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.642139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qh9bh" event={"ID":"8e5c9be1-aaa3-4feb-8dba-c7395ea64e75","Type":"ContainerStarted","Data":"a81e509741c5a581301170e6c5a17899d2344d77a704cb4b5c26f8d9ce0e2afb"} Jul 10 02:14:16.644276 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.644251 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="75f63e3f51a1e5b41f9b2f4036b2da1d40e537756c44ca2a7163aa45ca66d513" exitCode=0 Jul 10 02:14:16.644391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.644335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"75f63e3f51a1e5b41f9b2f4036b2da1d40e537756c44ca2a7163aa45ca66d513"} Jul 10 02:14:16.647171 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.647147 2567 generic.go:356] "Generic (PLEG): container finished" podID="47383da59210c19d0ffe6c754a0cf85d" containerID="9b2f2add5577a2b46c5d190b7f5cf8bcb79a37f760948d2651daf995400b5e5d" exitCode=0 Jul 10 02:14:16.647270 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.647238 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" event={"ID":"47383da59210c19d0ffe6c754a0cf85d","Type":"ContainerDied","Data":"9b2f2add5577a2b46c5d190b7f5cf8bcb79a37f760948d2651daf995400b5e5d"} Jul 10 02:14:16.671061 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.671019 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6msk" podStartSLOduration=2.3972612030000002 podStartE2EDuration="14.67100166s" totalImagesPullingTime="12.273740457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:16.653899299 +0000 UTC m=+15.714304325" watchObservedRunningTime="2026-07-10 02:14:16.67100166 +0000 UTC m=+15.731406684" Jul 10 02:14:16.709363 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.709317 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6nsr4" podStartSLOduration=2.41105115 podStartE2EDuration="14.709301931s" totalImagesPullingTime="12.298250781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:16.708901842 +0000 UTC m=+15.769306884" watchObservedRunningTime="2026-07-10 02:14:16.709301931 +0000 UTC m=+15.769706955" Jul 10 02:14:16.726195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.726146 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qh9bh" podStartSLOduration=2.378911086 podStartE2EDuration="14.726129471s" totalImagesPullingTime="12.347218385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:16.725759551 +0000 UTC m=+15.786164578" watchObservedRunningTime="2026-07-10 02:14:16.726129471 +0000 UTC m=+15.786534496" Jul 10 02:14:16.741431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:16.741343 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dmvz5" podStartSLOduration=2.407062803 podStartE2EDuration="14.741320374s" totalImagesPullingTime="12.334257571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:16.740713501 +0000 UTC m=+15.801118544" watchObservedRunningTime="2026-07-10 02:14:16.741320374 +0000 UTC m=+15.801725400" Jul 10 02:14:17.652098 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:17.652019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" event={"ID":"47383da59210c19d0ffe6c754a0cf85d","Type":"ContainerStarted","Data":"dd3036ca33ef2a79a38e42b743c4b80bb307d50023a71869bad895f4940102d5"} Jul 10 02:14:18.117313 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.117229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:18.117508 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.117384 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:18.117508 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.117444 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:14:34.117427921 +0000 UTC m=+33.177832929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:18.218391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.218357 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:18.218559 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.218425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:18.218559 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218532 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:18.218713 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218559 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:18.218713 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218589 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:18.218713 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218596 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:34.21857946 +0000 UTC m=+33.278984466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:18.218713 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218603 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:18.218713 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.218673 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:34.218640336 +0000 UTC m=+33.279045355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:18.467945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.467862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:18.468087 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.468039 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:18.468404 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.468382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:18.468476 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.468460 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:18.468542 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:18.468530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:18.468624 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:18.468606 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:19.524011 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:19.523971 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:19.524899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:19.524874 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:19.541072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:19.541025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-3.ec2.internal" podStartSLOduration=16.541010994 podStartE2EDuration="16.541010994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:17.668775465 +0000 UTC m=+16.729180514" watchObservedRunningTime="2026-07-10 02:14:19.541010994 +0000 UTC m=+18.601416019" Jul 10 02:14:20.467873 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:20.467641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:20.468050 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:20.467980 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:20.468428 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:20.468407 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:20.468727 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:20.468503 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:20.468727 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:20.468580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:20.468727 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:20.468688 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:22.467896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.467852 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:22.467896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.467887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:22.467896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.467905 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:22.468449 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:22.468029 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:22.468449 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:22.468185 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:22.468449 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:22.468317 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:22.968081 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.968049 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:22.968254 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.968210 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 02:14:22.968818 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:22.968791 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6nsr4" Jul 10 02:14:24.468029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:24.467989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:24.468625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:24.467989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:24.468625 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:24.468120 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:24.468625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:24.467989 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:24.468625 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:24.468190 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:24.468625 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:24.468319 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:26.468025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:26.467995 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:26.468025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:26.468026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:26.468538 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:26.468109 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:26.468538 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:26.468115 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:26.468538 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:26.468173 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:26.468538 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:26.468287 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:27.680803 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:27.680768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d9fxp" event={"ID":"6d3b5d3e-a44d-433a-ba2d-ac9d41684b76","Type":"ContainerStarted","Data":"f253220c1cf9be3bceef762a32e0bc02587e330ad191d0a43ed63b9b9bee23b2"} Jul 10 02:14:27.684973 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:27.684941 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 02:14:28.437756 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.437482 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T02:14:27.684962587Z","UUID":"091a070f-fc59-49ff-aae1-647aed3e2fae","Handler":null,"Name":"","Endpoint":""} Jul 10 02:14:28.438942 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.438917 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 02:14:28.439076 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.438955 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 02:14:28.467341 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.467316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:28.467464 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.467344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:28.467464 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.467316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:28.467464 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:28.467413 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:28.467675 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:28.467521 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:28.467675 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:28.467574 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:28.685087 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.685052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" event={"ID":"d6108e8d-401e-44aa-9ce2-d001b0599385","Type":"ContainerStarted","Data":"f05c6ab6154b0f8dfd69a880efb31094942ab44ea8031bfeaefc7c067e921029"} Jul 10 02:14:28.688504 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"37ce9eb93c44eca97886cba0e3047b52807720c2cf8fcf2e5fc1bddd84b1de83"} Jul 10 02:14:28.688639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"07802c55f96ffd981fcf6d35001d8e879ef64ebaf12938a1724fcec112b8ae9a"} Jul 10 02:14:28.688639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688570 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"3abb3fd49742f783f2e494207bef7338d45ae472cd1d672104e2f69ff97d0b9f"} Jul 10 02:14:28.688639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"025ced441f29066bcf19b212009475969d4e06b4da222fe379e1b10d96d5b597"} Jul 10 02:14:28.688825 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"5bc228c1794892a0031240cbd5feb907abe0324c6c3f16a5c5679111813f8ea1"} Jul 10 02:14:28.688825 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.688726 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"d29cee0a3749497aee576992f20a5647c5c04d78a0dbb1d8d45cbbc37049f8df"} Jul 10 02:14:28.690639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.690608 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="cdd23ca4ff30ec14682d6b186fa63a112aad1dfdc3b680a5ef74fdb160276f40" exitCode=0 Jul 10 02:14:28.690782 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.690694 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"cdd23ca4ff30ec14682d6b186fa63a112aad1dfdc3b680a5ef74fdb160276f40"} Jul 10 02:14:28.707987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:28.707940 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d9fxp" podStartSLOduration=1.967351162 podStartE2EDuration="26.707922915s" totalImagesPullingTime="24.740571753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:28.707798581 +0000 UTC m=+27.768203655" watchObservedRunningTime="2026-07-10 02:14:28.707922915 +0000 UTC m=+27.768327942" Jul 10 02:14:29.695211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:29.695173 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" event={"ID":"d6108e8d-401e-44aa-9ce2-d001b0599385","Type":"ContainerStarted","Data":"713b8cc8b287bc591b4473c97aaafd237478b4b1f81572e8f5c9f1a9c5051c18"} Jul 10 02:14:29.714479 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:29.714434 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5vkjj" podStartSLOduration=2.725097982 podStartE2EDuration="27.714420045s" totalImagesPullingTime="24.989322063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:29.714045998 +0000 UTC m=+28.774451022" watchObservedRunningTime="2026-07-10 02:14:29.714420045 +0000 UTC m=+28.774825070" Jul 10 02:14:30.467963 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.467937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:30.468113 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.467968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:30.468113 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.467949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:30.468113 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:30.468077 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:30.468326 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:30.468127 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:30.468326 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:30.468168 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:30.699197 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.699108 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="3dde65e53aaa342810c1f29bb6be4a9d0e0e2a118732617df280b9d21a7e178c" exitCode=0 Jul 10 02:14:30.699712 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.699187 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"3dde65e53aaa342810c1f29bb6be4a9d0e0e2a118732617df280b9d21a7e178c"} Jul 10 02:14:30.702638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:30.702619 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"926db5c61badb4c210e76583425fa3803214ff8d307b6673665ae84f8455ebd8"} Jul 10 02:14:32.467170 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.467135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:32.467608 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.467232 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:32.467608 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:32.467237 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:32.467608 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.467241 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:32.467608 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:32.467315 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:32.467608 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:32.467382 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:32.710119 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.709970 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="618d8904ba4ab99aa206304cdb5edcb5d173c2a242808577cd521e4e84ac414a" exitCode=0 Jul 10 02:14:32.710229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.710032 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"618d8904ba4ab99aa206304cdb5edcb5d173c2a242808577cd521e4e84ac414a"} Jul 10 02:14:32.714108 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.714088 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" event={"ID":"8f22b018-dfa4-418a-af81-656fd01c024f","Type":"ContainerStarted","Data":"d8f989e63fdaa0ff0b78caac8edc8bc9dab4f901561bc1c0c93aa500e1987617"} Jul 10 02:14:32.714376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.714352 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:32.714449 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.714421 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:32.714520 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.714473 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:32.731357 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.731278 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:32.731988 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.731969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:14:32.767297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:32.767256 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" podStartSLOduration=5.9584362760000005 podStartE2EDuration="30.767242404s" totalImagesPullingTime="24.808806128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:32.765821509 +0000 UTC m=+31.826226556" watchObservedRunningTime="2026-07-10 02:14:32.767242404 +0000 UTC m=+31.827647461" Jul 10 02:14:34.142449 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.142408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:34.142974 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.142595 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:34.142974 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.142709 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret podName:80aedb91-0c17-4538-9075-8a912b1e9e0f nodeName:}" failed. No retries permitted until 2026-07-10 02:15:06.142684507 +0000 UTC m=+65.203089533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret") pod "global-pull-secret-syncer-9xgbk" (UID: "80aedb91-0c17-4538-9075-8a912b1e9e0f") : object "kube-system"/"original-pull-secret" not registered Jul 10 02:14:34.242968 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.242936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:34.243105 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.242988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:34.243160 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243116 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 02:14:34.243160 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243133 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:34.243160 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243141 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 02:14:34.243160 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243152 2567 projected.go:196] Error preparing data for projected volume kube-api-access-ft9g6 for pod openshift-network-diagnostics/network-check-target-mctlk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:34.243330 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243183 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:06.243170191 +0000 UTC m=+65.303575197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 02:14:34.243330 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.243197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6 podName:1ecb4d3d-3ad6-4747-8f55-2c201af1b619 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:06.243189441 +0000 UTC m=+65.303594444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft9g6" (UniqueName: "kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6") pod "network-check-target-mctlk" (UID: "1ecb4d3d-3ad6-4747-8f55-2c201af1b619") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 02:14:34.467827 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.467752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:34.467992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.467752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:34.467992 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.467881 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:34.467992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.467752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:34.468117 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.468028 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:34.468117 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.468061 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:34.618148 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.618119 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xgbk"] Jul 10 02:14:34.620837 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.620807 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mctlk"] Jul 10 02:14:34.623393 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.623370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4mjq"] Jul 10 02:14:34.718808 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.718735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:34.718962 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.718735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:34.718962 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.718856 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:34.718962 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:34.718735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:34.719122 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.718976 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:34.719122 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:34.719034 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:36.467869 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:36.467824 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:36.468307 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:36.467832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:36.468307 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:36.467937 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:36.468307 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:36.468027 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:36.468307 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:36.467832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:36.468307 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:36.468116 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:38.467804 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:38.467605 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:38.468218 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:38.467676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:38.468218 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:38.467893 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:38.468218 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:38.467685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:38.468218 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:38.467956 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:38.468218 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:38.468111 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:39.731724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:39.731692 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="dc2233cda77ff8d1d8b1c9196bade9d40a654d8eb043ed60780d562555860c6c" exitCode=0 Jul 10 02:14:39.732154 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:39.731764 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"dc2233cda77ff8d1d8b1c9196bade9d40a654d8eb043ed60780d562555860c6c"} Jul 10 02:14:40.467356 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:40.467320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:40.467562 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:40.467419 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9xgbk" podUID="80aedb91-0c17-4538-9075-8a912b1e9e0f" Jul 10 02:14:40.467562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:40.467420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:40.467562 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:40.467480 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mctlk" podUID="1ecb4d3d-3ad6-4747-8f55-2c201af1b619" Jul 10 02:14:40.467562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:40.467425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:40.467562 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:40.467536 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b4mjq" podUID="bcf852c2-86fb-4722-9284-97be57533c80" Jul 10 02:14:40.737541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:40.737451 2567 generic.go:356] "Generic (PLEG): container finished" podID="75cbee37-71a5-4bb9-b29f-9874c3c1e358" containerID="d6e8d5323408945eba970b43ed305d5c67e285eb7c014d61dce8cdcafdfe2da2" exitCode=0 Jul 10 02:14:40.737541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:40.737488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerDied","Data":"d6e8d5323408945eba970b43ed305d5c67e285eb7c014d61dce8cdcafdfe2da2"} Jul 10 02:14:41.190332 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.190306 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-3.ec2.internal" event="NodeReady" Jul 10 02:14:41.190485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.190412 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 02:14:41.225451 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.225424 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9h6m"] Jul 10 02:14:41.239911 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.239830 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:14:41.240848 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.239853 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.244213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.243887 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nmngh\"" Jul 10 02:14:41.244213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.243913 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 02:14:41.244213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.243888 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 02:14:41.244213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.243990 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.244465 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.244282 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.249839 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.249818 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78bdbf6b7b-xklj9"] Jul 10 02:14:41.250214 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.249936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.254991 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.254965 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 02:14:41.257714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.256499 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nntqw\"" Jul 10 02:14:41.257714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.257132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 02:14:41.258767 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.258735 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 02:14:41.259506 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.259471 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 02:14:41.264328 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.263530 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 02:14:41.265916 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.265895 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4"] Jul 10 02:14:41.266854 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.266686 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.269517 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.269491 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 02:14:41.269753 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.269731 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 02:14:41.269887 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.269843 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 02:14:41.269950 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.269921 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.270002 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.269953 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 02:14:41.270246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.270228 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.270553 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.270334 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8mpfg\"" Jul 10 02:14:41.278742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.278727 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8"] Jul 10 02:14:41.278854 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.278840 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" Jul 10 02:14:41.281549 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.281533 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.281639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.281621 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xpvbz\"" Jul 10 02:14:41.281700 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.281639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.300796 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.300776 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx"] Jul 10 02:14:41.300896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.300880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.303059 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.303043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s2s6b\"" Jul 10 02:14:41.303362 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.303348 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.304202 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.304185 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 02:14:41.304349 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.304330 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.304449 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.304385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 02:14:41.326945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.326871 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl"] Jul 10 02:14:41.326945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.326941 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.329946 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.329928 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pctdf\"" Jul 10 02:14:41.329946 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.329956 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.330114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.329956 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.330114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.329984 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 02:14:41.330114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.329937 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 02:14:41.350997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.350980 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-gvffk"] Jul 10 02:14:41.351093 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.351079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.354974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.354944 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 02:14:41.355072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.354980 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.355072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.354990 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.355244 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.355229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jt5rk\"" Jul 10 02:14:41.355324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.355308 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 02:14:41.375389 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.375363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv"] Jul 10 02:14:41.375500 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.375469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.378240 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.378216 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tp4vn\"" Jul 10 02:14:41.378413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.378392 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 02:14:41.378555 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.378538 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 02:14:41.378783 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.378767 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.379331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.378975 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.383935 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.383910 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 02:14:41.391141 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391123 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9h6m"] Jul 10 02:14:41.391222 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391151 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4"] Jul 10 02:14:41.391222 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391164 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx"] Jul 10 02:14:41.391222 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391179 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svxwv"] Jul 10 02:14:41.391320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391273 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.391320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-tmp\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.391425 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.391425 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7232669a-92fa-4b6b-a3e1-282cd60de248-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.391425 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-stats-auth\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.391562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-serving-cert\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.391668 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391668 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgrrq\" (UniqueName: \"kubernetes.io/projected/7232669a-92fa-4b6b-a3e1-282cd60de248-kube-api-access-zgrrq\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.391773 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.391823 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp267\" (UniqueName: \"kubernetes.io/projected/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-kube-api-access-wp267\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.391823 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdx8\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.391901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8b28\" (UniqueName: \"kubernetes.io/projected/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-kube-api-access-j8b28\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.391975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6j8s\" (UniqueName: \"kubernetes.io/projected/78cf255a-9570-4f62-9401-7ea708727f5e-kube-api-access-j6j8s\") pod \"volume-data-source-validator-78495597f6-6vnr4\" (UID: \"78cf255a-9570-4f62-9401-7ea708727f5e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.392002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.392034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.392025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.392272 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.392040 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-default-certificate\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.392272 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.392062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-snapshots\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.393937 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.393921 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 02:14:41.394065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.394044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.394133 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.394044 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p5kk8\"" Jul 10 02:14:41.394273 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.394256 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.413268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.413237 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8"] Jul 10 02:14:41.413380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.413275 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp"] Jul 10 02:14:41.413380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.413306 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.416183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.416168 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcw54\"" Jul 10 02:14:41.416271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.416170 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 02:14:41.416271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.416219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 02:14:41.437295 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.437274 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dtrqw"] Jul 10 02:14:41.437401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.437384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" Jul 10 02:14:41.440089 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.440071 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.440173 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.440071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dmppg\"" Jul 10 02:14:41.440547 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.440533 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.457573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457553 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457595 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457615 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gvffk"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78bdbf6b7b-xklj9"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457692 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtrqw"] Jul 10 02:14:41.457714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457708 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp"] Jul 10 02:14:41.458020 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.457734 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svxwv"] Jul 10 02:14:41.460618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.460600 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 02:14:41.460714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.460600 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 02:14:41.460714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.460644 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 02:14:41.460924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.460902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2cc4f\"" Jul 10 02:14:41.493432 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-tmp\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.493432 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.493432 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-stats-auth\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdx8\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-serving-cert\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493544 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgrrq\" (UniqueName: \"kubernetes.io/projected/7232669a-92fa-4b6b-a3e1-282cd60de248-kube-api-access-zgrrq\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxgp8\" (UniqueName: \"kubernetes.io/projected/7e263ee6-46b2-4867-bc73-30942782931a-kube-api-access-qxgp8\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493641 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8b28\" (UniqueName: \"kubernetes.io/projected/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-kube-api-access-j8b28\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-trusted-ca\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.493723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-snapshots\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493860 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-tmp\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnjz\" (UniqueName: \"kubernetes.io/projected/d2591206-5fe5-40b4-8cca-1f4d135ded54-kube-api-access-6fnjz\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.493908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.493993 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494008 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494082 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494154 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:41.994133065 +0000 UTC m=+41.054538082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:41.494210 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494217 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494316 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:14:41.994301202 +0000 UTC m=+41.054706205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7232669a-92fa-4b6b-a3e1-282cd60de248-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e263ee6-46b2-4867-bc73-30942782931a-serving-cert\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7sl\" (UniqueName: \"kubernetes.io/projected/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-kube-api-access-7n7sl\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-default-certificate\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp267\" (UniqueName: \"kubernetes.io/projected/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-kube-api-access-wp267\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494676 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-snapshots\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.494768 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.494760 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:41.994744359 +0000 UTC m=+41.055149367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-config\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6j8s\" (UniqueName: \"kubernetes.io/projected/78cf255a-9570-4f62-9401-7ea708727f5e-kube-api-access-j6j8s\") pod \"volume-data-source-validator-78495597f6-6vnr4\" (UID: \"78cf255a-9570-4f62-9401-7ea708727f5e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9j8\" (UniqueName: \"kubernetes.io/projected/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-kube-api-access-wt9j8\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494986 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7232669a-92fa-4b6b-a3e1-282cd60de248-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.494997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-config\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.495345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.495518 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.495500 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:41.995485136 +0000 UTC m=+41.055890156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:41.495973 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.495546 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.496432 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.496406 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.496932 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.496909 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.497928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.497905 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-serving-cert\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.497999 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.497933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.497999 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.497906 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.497999 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.497914 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-stats-auth\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.498188 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.498173 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-default-certificate\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.504723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.504326 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgrrq\" (UniqueName: \"kubernetes.io/projected/7232669a-92fa-4b6b-a3e1-282cd60de248-kube-api-access-zgrrq\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:41.505777 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.505040 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdx8\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.507189 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.507143 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8b28\" (UniqueName: \"kubernetes.io/projected/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-kube-api-access-j8b28\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:41.508387 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.508364 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:41.508912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.508891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6j8s\" (UniqueName: \"kubernetes.io/projected/78cf255a-9570-4f62-9401-7ea708727f5e-kube-api-access-j6j8s\") pod \"volume-data-source-validator-78495597f6-6vnr4\" (UID: \"78cf255a-9570-4f62-9401-7ea708727f5e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" Jul 10 02:14:41.509083 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.509067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp267\" (UniqueName: \"kubernetes.io/projected/7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a-kube-api-access-wp267\") pod \"insights-operator-68d9dd94cf-k9h6m\" (UID: \"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a\") " pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.562906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.562873 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" Jul 10 02:14:41.586316 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.586280 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" Jul 10 02:14:41.596352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnjz\" (UniqueName: \"kubernetes.io/projected/d2591206-5fe5-40b4-8cca-1f4d135ded54-kube-api-access-6fnjz\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.596487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5458e934-ee21-47e2-9cfc-550c561603e5-cert\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.596487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jckjm\" (UniqueName: \"kubernetes.io/projected/5458e934-ee21-47e2-9cfc-550c561603e5-kube-api-access-jckjm\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.596487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e263ee6-46b2-4867-bc73-30942782931a-serving-cert\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.596487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7sl\" (UniqueName: \"kubernetes.io/projected/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-kube-api-access-7n7sl\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.596487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.596757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.596757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-config\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.596757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51326654-a5b0-4e47-a740-4cba35bf85a1-config-volume\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.596757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sknw\" (UniqueName: \"kubernetes.io/projected/af3ecd84-c543-4531-bc5e-3255cb2616c1-kube-api-access-7sknw\") pod \"network-check-source-869dcfcdcd-kgbcp\" (UID: \"af3ecd84-c543-4531-bc5e-3255cb2616c1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" Jul 10 02:14:41.596757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9j8\" (UniqueName: \"kubernetes.io/projected/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-kube-api-access-wt9j8\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.597009 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.596777 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:41.597009 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.596840 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:42.096820697 +0000 UTC m=+41.157225718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:41.597009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-config\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.597009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.596991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks6rf\" (UniqueName: \"kubernetes.io/projected/51326654-a5b0-4e47-a740-4cba35bf85a1-kube-api-access-ks6rf\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.597209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.597209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51326654-a5b0-4e47-a740-4cba35bf85a1-tmp-dir\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.597209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxgp8\" (UniqueName: \"kubernetes.io/projected/7e263ee6-46b2-4867-bc73-30942782931a-kube-api-access-qxgp8\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.597209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.597209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-trusted-ca\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.597446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.597446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597411 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-config\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.597446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597423 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-config\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.597597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.597532 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.600605 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.599323 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e263ee6-46b2-4867-bc73-30942782931a-serving-cert\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.600605 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.599758 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e263ee6-46b2-4867-bc73-30942782931a-trusted-ca\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.600605 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.600088 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.601899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.601874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-serving-cert\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.606345 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.606320 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnjz\" (UniqueName: \"kubernetes.io/projected/d2591206-5fe5-40b4-8cca-1f4d135ded54-kube-api-access-6fnjz\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:41.608549 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.608470 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9j8\" (UniqueName: \"kubernetes.io/projected/6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d-kube-api-access-wt9j8\") pod \"kube-storage-version-migrator-operator-799cb7f958-hj9jx\" (UID: \"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.608639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.608596 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7sl\" (UniqueName: \"kubernetes.io/projected/5f019e26-b91f-4f0d-b3f8-c9b4c83380b1-kube-api-access-7n7sl\") pod \"service-ca-operator-7695fc6c8c-zfrtl\" (UID: \"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.608991 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.608962 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxgp8\" (UniqueName: \"kubernetes.io/projected/7e263ee6-46b2-4867-bc73-30942782931a-kube-api-access-qxgp8\") pod \"console-operator-7866497494-gvffk\" (UID: \"7e263ee6-46b2-4867-bc73-30942782931a\") " pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.634598 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.634572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" Jul 10 02:14:41.658892 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.658732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" Jul 10 02:14:41.686938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.686807 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5458e934-ee21-47e2-9cfc-550c561603e5-cert\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jckjm\" (UniqueName: \"kubernetes.io/projected/5458e934-ee21-47e2-9cfc-550c561603e5-kube-api-access-jckjm\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51326654-a5b0-4e47-a740-4cba35bf85a1-config-volume\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sknw\" (UniqueName: \"kubernetes.io/projected/af3ecd84-c543-4531-bc5e-3255cb2616c1-kube-api-access-7sknw\") pod \"network-check-source-869dcfcdcd-kgbcp\" (UID: \"af3ecd84-c543-4531-bc5e-3255cb2616c1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700317 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks6rf\" (UniqueName: \"kubernetes.io/projected/51326654-a5b0-4e47-a740-4cba35bf85a1-kube-api-access-ks6rf\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.700551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51326654-a5b0-4e47-a740-4cba35bf85a1-tmp-dir\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.700981 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.700799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51326654-a5b0-4e47-a740-4cba35bf85a1-tmp-dir\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.702082 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.701880 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51326654-a5b0-4e47-a740-4cba35bf85a1-config-volume\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.702082 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.701998 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:41.702082 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:41.702062 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:42.202037 +0000 UTC m=+41.262442003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:41.707326 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.707276 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5458e934-ee21-47e2-9cfc-550c561603e5-cert\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.715470 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.715409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks6rf\" (UniqueName: \"kubernetes.io/projected/51326654-a5b0-4e47-a740-4cba35bf85a1-kube-api-access-ks6rf\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:41.719193 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.718988 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sknw\" (UniqueName: \"kubernetes.io/projected/af3ecd84-c543-4531-bc5e-3255cb2616c1-kube-api-access-7sknw\") pod \"network-check-source-869dcfcdcd-kgbcp\" (UID: \"af3ecd84-c543-4531-bc5e-3255cb2616c1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" Jul 10 02:14:41.723785 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.723636 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jckjm\" (UniqueName: \"kubernetes.io/projected/5458e934-ee21-47e2-9cfc-550c561603e5-kube-api-access-jckjm\") pod \"ingress-canary-dtrqw\" (UID: \"5458e934-ee21-47e2-9cfc-550c561603e5\") " pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.745591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.745386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" Jul 10 02:14:41.750198 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.750153 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52dvb" event={"ID":"75cbee37-71a5-4bb9-b29f-9874c3c1e358","Type":"ContainerStarted","Data":"66bad8ab6e0ab47c3bd2ee6fc849c80e4670910367532ff4302d5dd88fd6f964"} Jul 10 02:14:41.772975 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.771844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dtrqw" Jul 10 02:14:41.833568 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.832592 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52dvb" podStartSLOduration=7.98980844 podStartE2EDuration="39.832566689s" totalImagesPullingTime="31.842758249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:41.795425602 +0000 UTC m=+40.855830639" watchObservedRunningTime="2026-07-10 02:14:41.832566689 +0000 UTC m=+40.892971718" Jul 10 02:14:41.833568 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.833478 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4"] Jul 10 02:14:41.855051 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.854626 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-k9h6m"] Jul 10 02:14:41.860680 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.858980 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df8bbc5_9959_4d05_ab4e_682c0c8d3a6a.slice/crio-2133e093283df96ab260238f04e602e52785bb70e93ee0f690df684864a3f2fe WatchSource:0}: Error finding container 2133e093283df96ab260238f04e602e52785bb70e93ee0f690df684864a3f2fe: Status 404 returned error can't find the container with id 2133e093283df96ab260238f04e602e52785bb70e93ee0f690df684864a3f2fe Jul 10 02:14:41.869369 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.869340 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx"] Jul 10 02:14:41.874593 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.874565 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dda7f5f_4d7e_490c_bea3_ab5c9c145a6d.slice/crio-26e64d2e716c2cb5f41c761c6d98491efe75b30bc80718c94b2ab8bd859b84ac WatchSource:0}: Error finding container 26e64d2e716c2cb5f41c761c6d98491efe75b30bc80718c94b2ab8bd859b84ac: Status 404 returned error can't find the container with id 26e64d2e716c2cb5f41c761c6d98491efe75b30bc80718c94b2ab8bd859b84ac Jul 10 02:14:41.914904 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.914880 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl"] Jul 10 02:14:41.917809 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.917775 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f019e26_b91f_4f0d_b3f8_c9b4c83380b1.slice/crio-92c052bd93ad9d8ede693cd8fb59719524c727db4c582186c606e47d06275b17 WatchSource:0}: Error finding container 92c052bd93ad9d8ede693cd8fb59719524c727db4c582186c606e47d06275b17: Status 404 returned error can't find the container with id 92c052bd93ad9d8ede693cd8fb59719524c727db4c582186c606e47d06275b17 Jul 10 02:14:41.927616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.927576 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gvffk"] Jul 10 02:14:41.928325 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.928288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:41.933489 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.933458 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e263ee6_46b2_4867_bc73_30942782931a.slice/crio-94ffeac7511ab7e6635cf843c694d3adf528668a35c44151e0016d2182c8e81f WatchSource:0}: Error finding container 94ffeac7511ab7e6635cf843c694d3adf528668a35c44151e0016d2182c8e81f: Status 404 returned error can't find the container with id 94ffeac7511ab7e6635cf843c694d3adf528668a35c44151e0016d2182c8e81f Jul 10 02:14:41.972513 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.972484 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dtrqw"] Jul 10 02:14:41.974680 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.974636 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5458e934_ee21_47e2_9cfc_550c561603e5.slice/crio-8ba978cc7b54c591c83d4ff37bb1e7f83b04eddbaedd632e26d42165d3f234bf WatchSource:0}: Error finding container 8ba978cc7b54c591c83d4ff37bb1e7f83b04eddbaedd632e26d42165d3f234bf: Status 404 returned error can't find the container with id 8ba978cc7b54c591c83d4ff37bb1e7f83b04eddbaedd632e26d42165d3f234bf Jul 10 02:14:41.977314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:41.977296 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp"] Jul 10 02:14:41.979475 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:14:41.979456 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3ecd84_c543_4531_bc5e_3255cb2616c1.slice/crio-366897f19bf82507eb0642c5751f8ba4a645c932bdc209d63197b5e8b0eb5275 WatchSource:0}: Error finding container 366897f19bf82507eb0642c5751f8ba4a645c932bdc209d63197b5e8b0eb5275: Status 404 returned error can't find the container with id 366897f19bf82507eb0642c5751f8ba4a645c932bdc209d63197b5e8b0eb5275 Jul 10 02:14:42.009281 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.009254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:42.009417 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.009290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:42.009417 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.009311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:42.009417 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.009349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:42.009417 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009400 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009430 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009460 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.009445765 +0000 UTC m=+42.069850768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009403 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009481 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.009469254 +0000 UTC m=+42.069874259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009490 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009511 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.009495285 +0000 UTC m=+42.069900288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:42.009545 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.009535 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.009526678 +0000 UTC m=+42.069931681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:42.028849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.028815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:42.110360 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.110327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:42.110486 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.110467 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:42.110541 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.110532 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.110516733 +0000 UTC m=+42.170921736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:42.211596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.211561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:42.211773 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.211719 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:42.211818 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:42.211778 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:43.211762189 +0000 UTC m=+42.272167194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:42.467395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.467322 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:14:42.467395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.467354 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:14:42.467395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.467351 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:14:42.470705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.470680 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 02:14:42.470705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.470704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 02:14:42.470889 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.470854 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pmctl\"" Jul 10 02:14:42.470997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.470970 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htmn4\"" Jul 10 02:14:42.757458 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.757374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtrqw" event={"ID":"5458e934-ee21-47e2-9cfc-550c561603e5","Type":"ContainerStarted","Data":"8ba978cc7b54c591c83d4ff37bb1e7f83b04eddbaedd632e26d42165d3f234bf"} Jul 10 02:14:42.759176 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.759146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" event={"ID":"78cf255a-9570-4f62-9401-7ea708727f5e","Type":"ContainerStarted","Data":"bbd20acaf046449debf2a88997e41db603cd2870e464784e1566bb60981947ef"} Jul 10 02:14:42.761437 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.761410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" event={"ID":"af3ecd84-c543-4531-bc5e-3255cb2616c1","Type":"ContainerStarted","Data":"366897f19bf82507eb0642c5751f8ba4a645c932bdc209d63197b5e8b0eb5275"} Jul 10 02:14:42.762946 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.762921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerStarted","Data":"94ffeac7511ab7e6635cf843c694d3adf528668a35c44151e0016d2182c8e81f"} Jul 10 02:14:42.764422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.764398 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" event={"ID":"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1","Type":"ContainerStarted","Data":"92c052bd93ad9d8ede693cd8fb59719524c727db4c582186c606e47d06275b17"} Jul 10 02:14:42.765957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.765931 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" event={"ID":"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a","Type":"ContainerStarted","Data":"2133e093283df96ab260238f04e602e52785bb70e93ee0f690df684864a3f2fe"} Jul 10 02:14:42.769826 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:42.769762 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" event={"ID":"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d","Type":"ContainerStarted","Data":"26e64d2e716c2cb5f41c761c6d98491efe75b30bc80718c94b2ab8bd859b84ac"} Jul 10 02:14:43.020067 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.019982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:43.020067 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.020037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020153 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020160 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020183 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020214 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.020196592 +0000 UTC m=+44.080601604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020241 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.020221636 +0000 UTC m=+44.080626657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:43.020278 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.020269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:43.020584 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.020329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:43.020584 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020433 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.02042118 +0000 UTC m=+44.080826189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:43.020584 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020492 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:43.020584 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.020526 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.020515759 +0000 UTC m=+44.080920766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:43.121799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.121760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:43.122010 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.121992 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:43.122100 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.122075 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.122054296 +0000 UTC m=+44.182459311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:43.223193 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:43.223143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:43.223855 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.223431 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:43.223855 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:43.223498 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:45.223479151 +0000 UTC m=+44.283884181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:44.815139 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:44.814967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:45.041760 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.041717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.041783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.041820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.041853 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.041877 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.041924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.041943 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.041923352 +0000 UTC m=+48.102328370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:45.041953 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.041946 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:45.042284 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.042002 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.041985836 +0000 UTC m=+48.102390843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:45.042284 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.042061 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:45.042284 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.042067 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.04204586 +0000 UTC m=+48.102450877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:45.042284 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.042107 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.042095156 +0000 UTC m=+48.102500161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:45.142939 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.142843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:45.143146 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.143042 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:45.143146 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.143126 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.14310711 +0000 UTC m=+48.203512117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:45.243601 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:45.243560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:45.243776 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.243721 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:45.243818 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:45.243792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:49.243768252 +0000 UTC m=+48.304173255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:48.578952 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:48.578913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:48.681540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:48.681498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:49.081297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.081263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:49.081297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.081314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:49.081548 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.081400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:49.081548 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081419 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:49.081548 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.081464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:49.081548 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081481 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.081464249 +0000 UTC m=+56.141869255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:49.081548 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081549 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.081533973 +0000 UTC m=+56.141938979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:49.081827 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081562 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:49.081827 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081605 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.081594616 +0000 UTC m=+56.141999622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:49.081827 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081563 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:49.081827 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081632 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:49.081827 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.081700 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.081686016 +0000 UTC m=+56.142091020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:49.182315 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.182269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:49.182469 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.182413 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:49.182469 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.182466 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.182451396 +0000 UTC m=+56.242856402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:49.282847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.282810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:49.282991 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.282946 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:49.283030 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:49.283005 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:57.282986387 +0000 UTC m=+56.343391391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:49.501204 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.501166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:49.593642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.593616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:49.798598 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.798233 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" event={"ID":"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d","Type":"ContainerStarted","Data":"d5624a23afb19625775704e6bccefe037a392f08243b8a38755f9a0a17c1174b"} Jul 10 02:14:49.801116 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.800741 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dtrqw" event={"ID":"5458e934-ee21-47e2-9cfc-550c561603e5","Type":"ContainerStarted","Data":"419e60853ca64d2e25914b0eaec7043d76724bfdb8bbc0a6fc31e86fb8e92b44"} Jul 10 02:14:49.805097 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.804725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" event={"ID":"78cf255a-9570-4f62-9401-7ea708727f5e","Type":"ContainerStarted","Data":"120992491fc5111291bff8d85d1b5a941730cc06374985aaefae89f510c67741"} Jul 10 02:14:49.808353 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.808040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" event={"ID":"af3ecd84-c543-4531-bc5e-3255cb2616c1","Type":"ContainerStarted","Data":"da1b9653dedac10c36fca942b597b4218182a698f234a765d4c70f5daf9caa1f"} Jul 10 02:14:49.811331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.810539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerStarted","Data":"e456b7fe974e7bf3606867e1155f1d493b964219ffc6125f4d13053d3e3eb75e"} Jul 10 02:14:49.811331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.811280 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:49.812452 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.812434 2567 patch_prober.go:28] interesting pod/console-operator-7866497494-gvffk container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body= Jul 10 02:14:49.812700 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.812627 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.13:8443/readyz\": dial tcp 10.132.0.13:8443: connect: connection refused" Jul 10 02:14:49.814041 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.813598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" event={"ID":"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1","Type":"ContainerStarted","Data":"fac8a37882be942c248929c5427d8f8f3dadd78318b0fdd81c8f1b2dccbc938d"} Jul 10 02:14:49.816105 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.815702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" event={"ID":"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a","Type":"ContainerStarted","Data":"f2a4d2df2654167aeb80a8f5e6301075510984142d5a310fb939a8c10b0d2796"} Jul 10 02:14:49.822708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.822633 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" podStartSLOduration=20.182275754 podStartE2EDuration="27.822615384s" totalImagesPullingTime="7.64033963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.820269761 +0000 UTC m=+48.880674812" watchObservedRunningTime="2026-07-10 02:14:49.822615384 +0000 UTC m=+48.883020410" Jul 10 02:14:49.843265 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.842427 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-gvffk" podStartSLOduration=19.260681827 podStartE2EDuration="26.842406105s" totalImagesPullingTime="7.581724278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.842121729 +0000 UTC m=+48.902526755" watchObservedRunningTime="2026-07-10 02:14:49.842406105 +0000 UTC m=+48.902811131" Jul 10 02:14:49.864303 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.864082 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-kgbcp" podStartSLOduration=11.317337169 podStartE2EDuration="18.864062198s" totalImagesPullingTime="7.546725029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.862006971 +0000 UTC m=+48.922412016" watchObservedRunningTime="2026-07-10 02:14:49.864062198 +0000 UTC m=+48.924467224" Jul 10 02:14:49.882431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.882122 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dtrqw" podStartSLOduration=1.34137284 podStartE2EDuration="8.882103132s" totalImagesPullingTime="7.540730292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.881861236 +0000 UTC m=+48.942266263" watchObservedRunningTime="2026-07-10 02:14:49.882103132 +0000 UTC m=+48.942508159" Jul 10 02:14:49.928264 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.928151 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" podStartSLOduration=20.331101641 podStartE2EDuration="27.928128244s" totalImagesPullingTime="7.597026603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.926270273 +0000 UTC m=+48.986675299" watchObservedRunningTime="2026-07-10 02:14:49.928128244 +0000 UTC m=+48.988533264" Jul 10 02:14:49.928947 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.928910 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" podStartSLOduration=30.273122019 podStartE2EDuration="37.928879745s" totalImagesPullingTime="7.655757726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.906555599 +0000 UTC m=+48.966960625" watchObservedRunningTime="2026-07-10 02:14:49.928879745 +0000 UTC m=+48.989284771" Jul 10 02:14:49.946872 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:49.946692 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-6vnr4" podStartSLOduration=20.341227252 podStartE2EDuration="27.946675249s" totalImagesPullingTime="7.605447997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:14:49.945967096 +0000 UTC m=+49.006372143" watchObservedRunningTime="2026-07-10 02:14:49.946675249 +0000 UTC m=+49.007080277" Jul 10 02:14:50.057242 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.057208 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:50.129975 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.129941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:50.686576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.686545 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j489s"] Jul 10 02:14:50.700226 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.700200 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.703525 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.703508 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l6nlg\"" Jul 10 02:14:50.703844 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.703784 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 02:14:50.704263 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.704240 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 02:14:50.704569 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.704546 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j489s"] Jul 10 02:14:50.733422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.733392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:50.796691 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.796641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhn56\" (UniqueName: \"kubernetes.io/projected/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-api-access-hhn56\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.796832 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.796801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.796874 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.796849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.796906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.796882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b760545f-ca99-40c9-86bc-30854cdf3e48-crio-socket\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.796952 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.796901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760545f-ca99-40c9-86bc-30854cdf3e48-data-volume\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.799939 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.799913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:50.821723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.821694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/0.log" Jul 10 02:14:50.821856 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.821736 2567 generic.go:356] "Generic (PLEG): container finished" podID="7e263ee6-46b2-4867-bc73-30942782931a" containerID="e456b7fe974e7bf3606867e1155f1d493b964219ffc6125f4d13053d3e3eb75e" exitCode=255 Jul 10 02:14:50.821926 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.821852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerDied","Data":"e456b7fe974e7bf3606867e1155f1d493b964219ffc6125f4d13053d3e3eb75e"} Jul 10 02:14:50.822136 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.822119 2567 scope.go:117] "RemoveContainer" containerID="e456b7fe974e7bf3606867e1155f1d493b964219ffc6125f4d13053d3e3eb75e" Jul 10 02:14:50.897949 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.897911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhn56\" (UniqueName: \"kubernetes.io/projected/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-api-access-hhn56\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898337 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.898315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898411 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.898395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898475 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.898461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b760545f-ca99-40c9-86bc-30854cdf3e48-crio-socket\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.898488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760545f-ca99-40c9-86bc-30854cdf3e48-data-volume\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898846 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.898830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b760545f-ca99-40c9-86bc-30854cdf3e48-data-volume\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.898927 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:50.898907 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:14:50.898990 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:50.898978 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:51.398956788 +0000 UTC m=+50.459361797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:14:50.899040 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:50.898912 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 02:14:50.899079 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:50.899052 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:51.399034682 +0000 UTC m=+50.459439690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : configmap "kube-rbac-proxy" not found Jul 10 02:14:50.899079 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.899064 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b760545f-ca99-40c9-86bc-30854cdf3e48-crio-socket\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.910724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.910698 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhn56\" (UniqueName: \"kubernetes.io/projected/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-api-access-hhn56\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:50.994414 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:50.994381 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.095313 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.095280 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.210357 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.210326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.290772 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.290738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.351358 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.351313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.403099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.403069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:51.403256 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.403116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:51.403256 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:51.403246 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:14:51.403357 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:51.403266 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 02:14:51.403357 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:51.403320 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:52.403300652 +0000 UTC m=+51.463705671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:14:51.403357 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:51.403340 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:52.403330473 +0000 UTC m=+51.463735489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : configmap "kube-rbac-proxy" not found Jul 10 02:14:51.454405 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.454373 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.514625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.514600 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.688038 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.687948 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:51.689193 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.689159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.790176 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.790139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:51.826468 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.826441 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/1.log" Jul 10 02:14:51.826882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.826862 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/0.log" Jul 10 02:14:51.826987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.826904 2567 generic.go:356] "Generic (PLEG): container finished" podID="7e263ee6-46b2-4867-bc73-30942782931a" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" exitCode=255 Jul 10 02:14:51.826987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.826963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerDied","Data":"4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc"} Jul 10 02:14:51.827122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.827015 2567 scope.go:117] "RemoveContainer" containerID="e456b7fe974e7bf3606867e1155f1d493b964219ffc6125f4d13053d3e3eb75e" Jul 10 02:14:51.827225 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:51.827197 2567 scope.go:117] "RemoveContainer" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" Jul 10 02:14:51.827421 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:51.827402 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:14:52.411906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:52.411864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:52.412078 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:52.411947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:52.412078 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:52.412040 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:14:52.412240 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:52.412075 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 02:14:52.412240 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:52.412132 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:54.412110618 +0000 UTC m=+53.472515625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:14:52.412240 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:52.412149 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:54.412142106 +0000 UTC m=+53.472547109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : configmap "kube-rbac-proxy" not found Jul 10 02:14:52.485678 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:52.485639 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qh9bh_8e5c9be1-aaa3-4feb-8dba-c7395ea64e75/dns-node-resolver/0.log" Jul 10 02:14:52.831388 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:52.831363 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/1.log" Jul 10 02:14:52.831951 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:52.831761 2567 scope.go:117] "RemoveContainer" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" Jul 10 02:14:52.832026 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:52.831949 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:14:53.086091 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:53.086016 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6msk_e51de088-5c18-4515-bd39-a6a94b5fa19f/node-ca/0.log" Jul 10 02:14:53.355126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:53.355031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:53.426691 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:53.426637 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:53.886574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:53.886549 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtrqw_5458e934-ee21-47e2-9cfc-550c561603e5/serve-healthcheck-canary/0.log" Jul 10 02:14:54.423131 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:54.423093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:54.430046 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:54.430021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:54.430114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:54.430073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:54.430185 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:54.430169 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:14:54.430237 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:54.430202 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 02:14:54.430237 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:54.430226 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:58.43021278 +0000 UTC m=+57.490617784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:14:54.430334 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:54.430274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:14:58.43025499 +0000 UTC m=+57.490660010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : configmap "kube-rbac-proxy" not found Jul 10 02:14:54.937872 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:54.937839 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:57.157533 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.157493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.157549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.157597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.157688 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.157735 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.157770 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.15774898 +0000 UTC m=+72.218154006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : secret "router-metrics-certs-default" not found Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.157845 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls podName:7232669a-92fa-4b6b-a3e1-282cd60de248 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.157822981 +0000 UTC m=+72.218227987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2d4r8" (UID: "7232669a-92fa-4b6b-a3e1-282cd60de248") : secret "cluster-monitoring-operator-tls" not found Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.157875 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle podName:38e39d45-a1e4-401c-a14f-a7b02bc6a6ed nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.157867948 +0000 UTC m=+72.218272951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle") pod "router-default-78bdbf6b7b-xklj9" (UID: "38e39d45-a1e4-401c-a14f-a7b02bc6a6ed") : configmap references non-existent config key: service-ca.crt Jul 10 02:14:57.157998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.157930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:14:57.158252 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.158011 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 02:14:57.158252 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.158020 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5c6fc84d-6xlfx: secret "image-registry-tls" not found Jul 10 02:14:57.158252 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.158053 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls podName:2d442226-3d4c-4aa7-bfa2-e05ff3a6007c nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.158045297 +0000 UTC m=+72.218450299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls") pod "image-registry-f5c6fc84d-6xlfx" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c") : secret "image-registry-tls" not found Jul 10 02:14:57.188101 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.188046 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:57.258508 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.258478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:14:57.258678 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.258634 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 02:14:57.258738 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.258710 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls podName:d2591206-5fe5-40b4-8cca-1f4d135ded54 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.258694593 +0000 UTC m=+72.319099596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls") pod "cluster-samples-operator-65db858894-5gjmv" (UID: "d2591206-5fe5-40b4-8cca-1f4d135ded54") : secret "samples-operator-tls" not found Jul 10 02:14:57.359045 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:57.359007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:14:57.359246 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.359173 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 02:14:57.359311 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:57.359257 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls podName:51326654-a5b0-4e47-a740-4cba35bf85a1 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:13.35923606 +0000 UTC m=+72.419641069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls") pod "dns-default-svxwv" (UID: "51326654-a5b0-4e47-a740-4cba35bf85a1") : secret "dns-default-metrics-tls" not found Jul 10 02:14:58.470266 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:58.470233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:58.470760 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:58.470304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:14:58.470760 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:58.470379 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 02:14:58.470870 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:58.470804 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:14:58.470870 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:58.470812 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:06.470787716 +0000 UTC m=+65.531192730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : configmap "kube-rbac-proxy" not found Jul 10 02:14:58.470978 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:58.470879 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:06.470865574 +0000 UTC m=+65.531270577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:14:59.662524 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.662482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:59.763858 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.763817 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:59.811891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.811858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:14:59.812308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.812289 2567 scope.go:117] "RemoveContainer" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" Jul 10 02:14:59.812490 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:14:59.812468 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:14:59.863791 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.863761 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:14:59.963429 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:14:59.963348 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:00.088346 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:00.088312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:00.192300 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:00.192263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:00.569316 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:00.569282 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:01.176228 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.176190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:01.560450 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.560410 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:01.687994 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.687958 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:15:01.688382 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.688367 2567 scope.go:117] "RemoveContainer" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" Jul 10 02:15:01.765029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.764999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:01.861096 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861075 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:15:01.861489 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861475 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/1.log" Jul 10 02:15:01.861560 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861508 2567 generic.go:356] "Generic (PLEG): container finished" podID="7e263ee6-46b2-4867-bc73-30942782931a" containerID="bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8" exitCode=255 Jul 10 02:15:01.861595 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerDied","Data":"bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8"} Jul 10 02:15:01.861628 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861616 2567 scope.go:117] "RemoveContainer" containerID="4f50541b483a6a6fa75486ad7f36cf39e7bcf4caa27289a97c18bb1e5f9ad0bc" Jul 10 02:15:01.861938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:01.861922 2567 scope.go:117] "RemoveContainer" containerID="bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8" Jul 10 02:15:01.862122 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:01.862103 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:15:02.170589 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:02.170505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:02.377892 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:02.377847 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:02.762484 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:02.762449 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:02.865998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:02.865972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:15:03.160424 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:03.160338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:03.358831 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:03.358796 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:03.560559 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:03.560525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:03.661785 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:03.661758 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:03.942681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:03.942565 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:04.002620 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.002586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:04.161066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.161025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:04.262161 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.262122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:04.563294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.563212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:04.730220 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.730197 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-229w6" Jul 10 02:15:04.959694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:04.959576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:05.060954 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:05.060919 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:05.162350 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:05.162316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:05.588633 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:05.588596 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:05.758088 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:05.758049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:05.872930 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:05.872840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:06.144681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.144585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:15:06.147490 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.147473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 02:15:06.157872 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.157853 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80aedb91-0c17-4538-9075-8a912b1e9e0f-original-pull-secret\") pod \"global-pull-secret-syncer-9xgbk\" (UID: \"80aedb91-0c17-4538-9075-8a912b1e9e0f\") " pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:15:06.164682 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.164638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:06.188983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.188962 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9xgbk" Jul 10 02:15:06.245632 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.245593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:15:06.245798 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.245708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:15:06.248524 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.248498 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 02:15:06.248524 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.248518 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft9g6\" (UniqueName: \"kubernetes.io/projected/1ecb4d3d-3ad6-4747-8f55-2c201af1b619-kube-api-access-ft9g6\") pod \"network-check-target-mctlk\" (UID: \"1ecb4d3d-3ad6-4747-8f55-2c201af1b619\") " pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:15:06.256882 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:06.256858 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 02:15:06.257017 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:06.256933 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs podName:bcf852c2-86fb-4722-9284-97be57533c80 nodeName:}" failed. No retries permitted until 2026-07-10 02:16:10.256909642 +0000 UTC m=+129.317314648 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs") pod "network-metrics-daemon-b4mjq" (UID: "bcf852c2-86fb-4722-9284-97be57533c80") : secret "metrics-daemon-secret" not found Jul 10 02:15:06.317427 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.317389 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9xgbk"] Jul 10 02:15:06.321250 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:06.321210 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aedb91_0c17_4538_9075_8a912b1e9e0f.slice/crio-7b8d1cc3bfb12e0ca55c8c272e61c537db55159543b5694c76328c7e486f407d WatchSource:0}: Error finding container 7b8d1cc3bfb12e0ca55c8c272e61c537db55159543b5694c76328c7e486f407d: Status 404 returned error can't find the container with id 7b8d1cc3bfb12e0ca55c8c272e61c537db55159543b5694c76328c7e486f407d Jul 10 02:15:06.360615 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.360547 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:06.485245 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.482054 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pmctl\"" Jul 10 02:15:06.489115 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.489087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:15:06.548940 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.548909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:06.549073 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.549040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:06.549165 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:06.549152 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 02:15:06.549223 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:06.549214 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls podName:b760545f-ca99-40c9-86bc-30854cdf3e48 nodeName:}" failed. No retries permitted until 2026-07-10 02:15:22.549197502 +0000 UTC m=+81.609602507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j489s" (UID: "b760545f-ca99-40c9-86bc-30854cdf3e48") : secret "insights-runtime-extractor-tls" not found Jul 10 02:15:06.549421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.549404 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b760545f-ca99-40c9-86bc-30854cdf3e48-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:06.565808 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.565775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:06.619037 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.619004 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mctlk"] Jul 10 02:15:06.622174 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:06.622147 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecb4d3d_3ad6_4747_8f55_2c201af1b619.slice/crio-f6335c277db3a90f0a9044ad9815dbf71268d7dd7f674cb510c8558482ebd99a WatchSource:0}: Error finding container f6335c277db3a90f0a9044ad9815dbf71268d7dd7f674cb510c8558482ebd99a: Status 404 returned error can't find the container with id f6335c277db3a90f0a9044ad9815dbf71268d7dd7f674cb510c8558482ebd99a Jul 10 02:15:06.762850 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.762774 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:06.878935 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.878895 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mctlk" event={"ID":"1ecb4d3d-3ad6-4747-8f55-2c201af1b619","Type":"ContainerStarted","Data":"195882075dcf2a7392ab5768264b1a41a1b7912d64a0cfb2cc4200c90a678eed"} Jul 10 02:15:06.879132 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.878950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mctlk" event={"ID":"1ecb4d3d-3ad6-4747-8f55-2c201af1b619","Type":"ContainerStarted","Data":"f6335c277db3a90f0a9044ad9815dbf71268d7dd7f674cb510c8558482ebd99a"} Jul 10 02:15:06.879132 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.879014 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:15:06.880051 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.880030 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xgbk" event={"ID":"80aedb91-0c17-4538-9075-8a912b1e9e0f","Type":"ContainerStarted","Data":"7b8d1cc3bfb12e0ca55c8c272e61c537db55159543b5694c76328c7e486f407d"} Jul 10 02:15:06.899833 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:06.899779 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mctlk" podStartSLOduration=64.899757285 podStartE2EDuration="1m4.899757285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:06.898825505 +0000 UTC m=+65.959230530" watchObservedRunningTime="2026-07-10 02:15:06.899757285 +0000 UTC m=+65.960162313" Jul 10 02:15:07.765152 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:07.765115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:07.967492 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:07.967455 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:08.158637 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:08.158530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:08.560106 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:08.560022 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:09.164015 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:09.163970 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:09.557801 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:09.557766 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:09.760435 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:09.760397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:09.812130 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:09.812067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:15:09.812413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:09.812397 2567 scope.go:117] "RemoveContainer" containerID="bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8" Jul 10 02:15:09.812597 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:09.812576 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:15:10.159757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:10.159630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:10.360564 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:10.360530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:11.687937 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:11.687902 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:15:11.688391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:11.688369 2567 scope.go:117] "RemoveContainer" containerID="bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8" Jul 10 02:15:11.688565 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:11.688540 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gvffk_openshift-console-operator(7e263ee6-46b2-4867-bc73-30942782931a)\"" pod="openshift-console-operator/console-operator-7866497494-gvffk" podUID="7e263ee6-46b2-4867-bc73-30942782931a" Jul 10 02:15:12.900740 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:12.900697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9xgbk" event={"ID":"80aedb91-0c17-4538-9075-8a912b1e9e0f","Type":"ContainerStarted","Data":"8a3528d380d73eff762a5d883d9909a66d12de354e7dda5158813f81fb4fbbef"} Jul 10 02:15:12.918509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:12.918459 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9xgbk" podStartSLOduration=65.133437014 podStartE2EDuration="1m10.918444238s" totalImagesPullingTime="5.785007224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:12.917628945 +0000 UTC m=+71.978033984" watchObservedRunningTime="2026-07-10 02:15:12.918444238 +0000 UTC m=+71.978849262" Jul 10 02:15:13.209638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.209540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:15:13.209638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.209589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:13.209638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.209610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:15:13.209638 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.209639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:13.210471 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.210445 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-service-ca-bundle\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:13.212192 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.212162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e39d45-a1e4-401c-a14f-a7b02bc6a6ed-metrics-certs\") pod \"router-default-78bdbf6b7b-xklj9\" (UID: \"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed\") " pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:13.212289 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.212162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7232669a-92fa-4b6b-a3e1-282cd60de248-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2d4r8\" (UID: \"7232669a-92fa-4b6b-a3e1-282cd60de248\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:15:13.212289 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.212232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"image-registry-f5c6fc84d-6xlfx\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:15:13.283526 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.283485 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld"] Jul 10 02:15:13.286820 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.286799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.301282 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.301261 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 02:15:13.302314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.302297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 02:15:13.302367 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.302304 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 02:15:13.305705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.305673 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 02:15:13.311224 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.311201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:15:13.313627 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.313608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d2591206-5fe5-40b4-8cca-1f4d135ded54-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5gjmv\" (UID: \"d2591206-5fe5-40b4-8cca-1f4d135ded54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:15:13.323531 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.323510 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld"] Jul 10 02:15:13.374623 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.374595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nntqw\"" Jul 10 02:15:13.380945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.380929 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8mpfg\"" Jul 10 02:15:13.381996 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.381978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:15:13.389048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.389019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:13.412685 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.412635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:15:13.412801 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.412758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fdee259e-d4ea-4b55-9703-aa5ff0a50951-klusterlet-config\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.412864 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.412818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee259e-d4ea-4b55-9703-aa5ff0a50951-tmp\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.412864 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.412848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgk96\" (UniqueName: \"kubernetes.io/projected/fdee259e-d4ea-4b55-9703-aa5ff0a50951-kube-api-access-pgk96\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.415061 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.415036 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51326654-a5b0-4e47-a740-4cba35bf85a1-metrics-tls\") pod \"dns-default-svxwv\" (UID: \"51326654-a5b0-4e47-a740-4cba35bf85a1\") " pod="openshift-dns/dns-default-svxwv" Jul 10 02:15:13.416338 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.416318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s2s6b\"" Jul 10 02:15:13.419788 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.419773 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" Jul 10 02:15:13.501792 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.501765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:13.503910 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.503691 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p5kk8\"" Jul 10 02:15:13.511182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.510998 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" Jul 10 02:15:13.514643 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.514567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fdee259e-d4ea-4b55-9703-aa5ff0a50951-klusterlet-config\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.514772 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.514645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee259e-d4ea-4b55-9703-aa5ff0a50951-tmp\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.514772 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.514698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgk96\" (UniqueName: \"kubernetes.io/projected/fdee259e-d4ea-4b55-9703-aa5ff0a50951-kube-api-access-pgk96\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.515581 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.515368 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee259e-d4ea-4b55-9703-aa5ff0a50951-tmp\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.518842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.518793 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fdee259e-d4ea-4b55-9703-aa5ff0a50951-klusterlet-config\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.523761 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.523740 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcw54\"" Jul 10 02:15:13.532492 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.531979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svxwv" Jul 10 02:15:13.534417 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.534396 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgk96\" (UniqueName: \"kubernetes.io/projected/fdee259e-d4ea-4b55-9703-aa5ff0a50951-kube-api-access-pgk96\") pod \"klusterlet-addon-workmgr-686dd64c55-68gld\" (UID: \"fdee259e-d4ea-4b55-9703-aa5ff0a50951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.562286 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.561580 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:15:13.564544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.563748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78bdbf6b7b-xklj9"] Jul 10 02:15:13.565286 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:13.564943 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d442226_3d4c_4aa7_bfa2_e05ff3a6007c.slice/crio-96b7f37fd193751553e5f9aa2266042f9d6c923aa7cdbe84c6eb4e0111a7e329 WatchSource:0}: Error finding container 96b7f37fd193751553e5f9aa2266042f9d6c923aa7cdbe84c6eb4e0111a7e329: Status 404 returned error can't find the container with id 96b7f37fd193751553e5f9aa2266042f9d6c923aa7cdbe84c6eb4e0111a7e329 Jul 10 02:15:13.567913 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:13.567872 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e39d45_a1e4_401c_a14f_a7b02bc6a6ed.slice/crio-c53884b2166e8e4ce2740cae87e6476fdaab9088739de7a1c3a9df74e5c77e3a WatchSource:0}: Error finding container c53884b2166e8e4ce2740cae87e6476fdaab9088739de7a1c3a9df74e5c77e3a: Status 404 returned error can't find the container with id c53884b2166e8e4ce2740cae87e6476fdaab9088739de7a1c3a9df74e5c77e3a Jul 10 02:15:13.588099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.588070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8"] Jul 10 02:15:13.594727 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:13.594681 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7232669a_92fa_4b6b_a3e1_282cd60de248.slice/crio-4d7c047ddcf58e8277de47564b513d4b7697cb4222f6ac756d3b26e49a9471e6 WatchSource:0}: Error finding container 4d7c047ddcf58e8277de47564b513d4b7697cb4222f6ac756d3b26e49a9471e6: Status 404 returned error can't find the container with id 4d7c047ddcf58e8277de47564b513d4b7697cb4222f6ac756d3b26e49a9471e6 Jul 10 02:15:13.594886 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.594838 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:13.596024 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.595797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:13.693065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.692979 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv"] Jul 10 02:15:13.695874 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.695604 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:13.729371 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.729347 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svxwv"] Jul 10 02:15:13.731874 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:13.731836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51326654_a5b0_4e47_a740_4cba35bf85a1.slice/crio-069337f8cc5e5d52b96785877de750b293aa11c70f832f9357df0d1cf7be8915 WatchSource:0}: Error finding container 069337f8cc5e5d52b96785877de750b293aa11c70f832f9357df0d1cf7be8915: Status 404 returned error can't find the container with id 069337f8cc5e5d52b96785877de750b293aa11c70f832f9357df0d1cf7be8915 Jul 10 02:15:13.808256 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.808220 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld"] Jul 10 02:15:13.811662 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:13.811611 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdee259e_d4ea_4b55_9703_aa5ff0a50951.slice/crio-579f3276131fa43f36723ccf5098e6ed8a3643d16752777a5c295f0b0d19616d WatchSource:0}: Error finding container 579f3276131fa43f36723ccf5098e6ed8a3643d16752777a5c295f0b0d19616d: Status 404 returned error can't find the container with id 579f3276131fa43f36723ccf5098e6ed8a3643d16752777a5c295f0b0d19616d Jul 10 02:15:13.812297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.812251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:13.892960 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.892906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:13.905473 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.905440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" event={"ID":"fdee259e-d4ea-4b55-9703-aa5ff0a50951","Type":"ContainerStarted","Data":"579f3276131fa43f36723ccf5098e6ed8a3643d16752777a5c295f0b0d19616d"} Jul 10 02:15:13.906976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.906948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" event={"ID":"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed","Type":"ContainerStarted","Data":"d39c88e1ac62a92dd042fd4aecea696905b4de690c713bca460251618a49fcbc"} Jul 10 02:15:13.907092 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.906998 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" event={"ID":"38e39d45-a1e4-401c-a14f-a7b02bc6a6ed","Type":"ContainerStarted","Data":"c53884b2166e8e4ce2740cae87e6476fdaab9088739de7a1c3a9df74e5c77e3a"} Jul 10 02:15:13.908590 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.908567 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" event={"ID":"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c","Type":"ContainerStarted","Data":"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87"} Jul 10 02:15:13.908751 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.908607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" event={"ID":"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c","Type":"ContainerStarted","Data":"96b7f37fd193751553e5f9aa2266042f9d6c923aa7cdbe84c6eb4e0111a7e329"} Jul 10 02:15:13.908751 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.908636 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:15:13.909907 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.909885 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svxwv" event={"ID":"51326654-a5b0-4e47-a740-4cba35bf85a1","Type":"ContainerStarted","Data":"069337f8cc5e5d52b96785877de750b293aa11c70f832f9357df0d1cf7be8915"} Jul 10 02:15:13.911048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.911025 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" event={"ID":"7232669a-92fa-4b6b-a3e1-282cd60de248","Type":"ContainerStarted","Data":"4d7c047ddcf58e8277de47564b513d4b7697cb4222f6ac756d3b26e49a9471e6"} Jul 10 02:15:13.912242 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.912216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" event={"ID":"d2591206-5fe5-40b4-8cca-1f4d135ded54","Type":"ContainerStarted","Data":"047735d6491941dffb35b1cea74510ad1b94ee7a0463badef5f6f3d85257a88e"} Jul 10 02:15:13.932457 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.932403 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" podStartSLOduration=61.932384791 podStartE2EDuration="1m1.932384791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:13.931009126 +0000 UTC m=+72.991414171" watchObservedRunningTime="2026-07-10 02:15:13.932384791 +0000 UTC m=+72.992789819" Jul 10 02:15:13.963162 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.963113 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" podStartSLOduration=71.963096737 podStartE2EDuration="1m11.963096737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:13.961913975 +0000 UTC m=+73.022319018" watchObservedRunningTime="2026-07-10 02:15:13.963096737 +0000 UTC m=+73.023501763" Jul 10 02:15:13.963702 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:13.963674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:14.389925 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.389894 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:14.392866 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.392839 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:14.400184 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.400132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:14.468778 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.468640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:14.810399 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.810330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:14.869576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.869542 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:14.935062 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.934644 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:14.936754 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:14.936285 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78bdbf6b7b-xklj9" Jul 10 02:15:15.446874 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:15.446763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:15.539187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:15.539150 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:15.601054 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:15.600994 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:15.658341 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:15.658306 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:15.999486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:15.999454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:16.100918 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:16.100880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:16.804633 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:16.804598 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:17.208604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:17.208524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:17.308819 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:17.308780 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:18.204155 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:18.204115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:18.304189 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:18.304158 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:18.601433 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:18.601396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:18.659642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:18.659548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:19.777743 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.777712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:19.877377 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.877342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:19.941714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.941619 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svxwv" event={"ID":"51326654-a5b0-4e47-a740-4cba35bf85a1","Type":"ContainerStarted","Data":"5157858ad53ec6410d681b69ca92ea5cde401b4fd5c914dc7248b8d557f3289e"} Jul 10 02:15:19.943271 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.943240 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" event={"ID":"7232669a-92fa-4b6b-a3e1-282cd60de248","Type":"ContainerStarted","Data":"cfdbeca57421ecd3ca7a897fc7c262948d55152caf106b74ff546399ba7711b0"} Jul 10 02:15:19.944938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.944909 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" event={"ID":"d2591206-5fe5-40b4-8cca-1f4d135ded54","Type":"ContainerStarted","Data":"84fb7db17faf19f063c721944bd098a68ab018831b27906e0434128902494d67"} Jul 10 02:15:19.965000 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:19.964951 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2d4r8" podStartSLOduration=61.893382792 podStartE2EDuration="1m7.964934815s" totalImagesPullingTime="6.071552023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:19.96430533 +0000 UTC m=+79.024710356" watchObservedRunningTime="2026-07-10 02:15:19.964934815 +0000 UTC m=+79.025339840" Jul 10 02:15:20.104195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.104166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:20.198911 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.198831 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:20.290853 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.290820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:20.468145 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.468051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:20.950472 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.950433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svxwv" event={"ID":"51326654-a5b0-4e47-a740-4cba35bf85a1","Type":"ContainerStarted","Data":"84b3d250d91caecdc7094639d4d39d1881c4283befd556f5d3dea95aa7be15c2"} Jul 10 02:15:20.950973 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.950537 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svxwv" Jul 10 02:15:20.952335 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.952304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" event={"ID":"d2591206-5fe5-40b4-8cca-1f4d135ded54","Type":"ContainerStarted","Data":"fabddf5f651ad92f1ce4b5b689d26487351967aea38924505baa01bf6c00da7a"} Jul 10 02:15:20.953772 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.953731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" event={"ID":"fdee259e-d4ea-4b55-9703-aa5ff0a50951","Type":"ContainerStarted","Data":"d0299fb9f7b99fde72c8a8c054ddcd21939f9749796b8f57ea225f390a1619e0"} Jul 10 02:15:20.971691 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.971623 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-svxwv" podStartSLOduration=34.027502834 podStartE2EDuration="39.971611082s" totalImagesPullingTime="5.944108248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:20.969726976 +0000 UTC m=+80.030132019" watchObservedRunningTime="2026-07-10 02:15:20.971611082 +0000 UTC m=+80.032016107" Jul 10 02:15:20.988068 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:20.988025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5gjmv" podStartSLOduration=52.08181617 podStartE2EDuration="57.988007607s" totalImagesPullingTime="5.906191437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:20.987633593 +0000 UTC m=+80.048038617" watchObservedRunningTime="2026-07-10 02:15:20.988007607 +0000 UTC m=+80.048412633" Jul 10 02:15:21.184552 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:21.184516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:21.242233 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:21.242148 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:21.957636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:21.957596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:21.959028 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:21.959008 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" Jul 10 02:15:21.974428 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:21.974377 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686dd64c55-68gld" podStartSLOduration=2.7787731989999997 podStartE2EDuration="8.974360848s" totalImagesPullingTime="6.195587649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:21.006956674 +0000 UTC m=+80.067361698" watchObservedRunningTime="2026-07-10 02:15:21.974360848 +0000 UTC m=+81.034765873" Jul 10 02:15:22.590983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:22.590946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:22.593398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:22.593373 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b760545f-ca99-40c9-86bc-30854cdf3e48-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j489s\" (UID: \"b760545f-ca99-40c9-86bc-30854cdf3e48\") " pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:22.816117 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:22.816083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l6nlg\"" Jul 10 02:15:22.823729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:22.823704 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j489s" Jul 10 02:15:22.960101 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:22.960079 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j489s"] Jul 10 02:15:22.961993 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:22.961970 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb760545f_ca99_40c9_86bc_30854cdf3e48.slice/crio-a3505c1a0440a95d1bc6f5151364e20d7980f1336a52b457ae801e81fa95a0a0 WatchSource:0}: Error finding container a3505c1a0440a95d1bc6f5151364e20d7980f1336a52b457ae801e81fa95a0a0: Status 404 returned error can't find the container with id a3505c1a0440a95d1bc6f5151364e20d7980f1336a52b457ae801e81fa95a0a0 Jul 10 02:15:23.196178 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:23.196088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:23.298009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:23.297978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:23.967173 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:23.967139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j489s" event={"ID":"b760545f-ca99-40c9-86bc-30854cdf3e48","Type":"ContainerStarted","Data":"a3505c1a0440a95d1bc6f5151364e20d7980f1336a52b457ae801e81fa95a0a0"} Jul 10 02:15:24.467981 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:24.467952 2567 scope.go:117] "RemoveContainer" containerID="bf68073b85fc640741a713e22cacd5584262778769066c0c67628c5cda641ee8" Jul 10 02:15:26.979948 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:26.979875 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:15:26.980373 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:26.979999 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gvffk" event={"ID":"7e263ee6-46b2-4867-bc73-30942782931a","Type":"ContainerStarted","Data":"30f2316ca86c7faf01ce3500bb55d32e637c745c577d9af8bd90b9710c12e7c3"} Jul 10 02:15:26.980435 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:26.980418 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:15:26.981796 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:26.981772 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j489s" event={"ID":"b760545f-ca99-40c9-86bc-30854cdf3e48","Type":"ContainerStarted","Data":"05d7e65dc76632274a5f98caead94f59093599d5f0e99549d8da14da785b7f3a"} Jul 10 02:15:27.450356 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.450316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-gvffk" Jul 10 02:15:27.661457 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.661364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:27.760744 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.760703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:27.860527 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.860481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:27.971187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.971092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:27.992634 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:27.990868 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j489s" event={"ID":"b760545f-ca99-40c9-86bc-30854cdf3e48","Type":"ContainerStarted","Data":"7df458db02507b6631b2dba7bfb910051b7871b33eac034ceec4f5ea6c44c3ad"} Jul 10 02:15:28.311842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.311798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:28.391040 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.391002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:28.472964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.472918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:28.596863 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.596762 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:28.697446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.697413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:28.799728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:28.799695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:29.527079 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:29.527033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:29.719175 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:29.719134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:29.892386 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:29.892308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:29.999917 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:29.999891 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j489s" event={"ID":"b760545f-ca99-40c9-86bc-30854cdf3e48","Type":"ContainerStarted","Data":"7eeb8489f5abdae7aecccb386cffbcbc052bcf6d171e3959b8e00c77293983ea"} Jul 10 02:15:30.018486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:30.018434 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j489s" podStartSLOduration=33.205979376 podStartE2EDuration="40.018419132s" totalImagesPullingTime="6.812439756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:14:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:30.017670796 +0000 UTC m=+89.078075843" watchObservedRunningTime="2026-07-10 02:15:30.018419132 +0000 UTC m=+89.078824156" Jul 10 02:15:30.142689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:30.142589 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:30.242173 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:30.242132 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:30.958867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:30.958839 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svxwv" Jul 10 02:15:31.848089 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:31.848058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:31.949409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:31.949366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:32.096366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:32.096327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:32.274445 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:32.274410 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:32.331875 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:32.331841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:34.517405 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.517366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:34.771837 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.771742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:34.855672 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.855620 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h6ftl"] Jul 10 02:15:34.860208 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.860184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:34.863898 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.863875 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t929n\"" Jul 10 02:15:34.864039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.864024 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 02:15:34.864113 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.864067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 02:15:34.864876 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.864858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 02:15:34.865122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.865100 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 02:15:34.866061 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.866037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:34.930920 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.930889 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:15:34.943165 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:34.943135 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.004449 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004628 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-root\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004628 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-metrics-client-ca\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004628 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcbr\" (UniqueName: \"kubernetes.io/projected/591496af-4920-4c51-b2f5-97a727d0eaef-kube-api-access-flcbr\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004824 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-sys\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-wtmp\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004909 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-textfile\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.004997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.004978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.005048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.005029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.052337 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.052251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.106143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-root\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-metrics-client-ca\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcbr\" (UniqueName: \"kubernetes.io/projected/591496af-4920-4c51-b2f5-97a727d0eaef-kube-api-access-flcbr\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-sys\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-wtmp\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-textfile\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106314 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-root\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106372 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-sys\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106478 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-wtmp\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:35.106524 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 02:15:35.106618 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:15:35.106589 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls podName:591496af-4920-4c51-b2f5-97a727d0eaef nodeName:}" failed. No retries permitted until 2026-07-10 02:15:35.606573188 +0000 UTC m=+94.666978383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls") pod "node-exporter-h6ftl" (UID: "591496af-4920-4c51-b2f5-97a727d0eaef") : secret "node-exporter-tls" not found Jul 10 02:15:35.106964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106678 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-textfile\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106749 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.106964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.106797 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/591496af-4920-4c51-b2f5-97a727d0eaef-metrics-client-ca\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.108781 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.108761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.122841 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.122819 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcbr\" (UniqueName: \"kubernetes.io/projected/591496af-4920-4c51-b2f5-97a727d0eaef-kube-api-access-flcbr\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.151927 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.151890 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.246255 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.246223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.312460 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.312385 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.435384 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.435346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.610754 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.610675 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.613039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.613021 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/591496af-4920-4c51-b2f5-97a727d0eaef-node-exporter-tls\") pod \"node-exporter-h6ftl\" (UID: \"591496af-4920-4c51-b2f5-97a727d0eaef\") " pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.726893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.726850 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.770510 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.770477 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6ftl" Jul 10 02:15:35.782345 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:35.782318 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591496af_4920_4c51_b2f5_97a727d0eaef.slice/crio-cfb31c3aef5fbc157e190af1841bb5d5ebb34d852e6ead14912dadded3307d37 WatchSource:0}: Error finding container cfb31c3aef5fbc157e190af1841bb5d5ebb34d852e6ead14912dadded3307d37: Status 404 returned error can't find the container with id cfb31c3aef5fbc157e190af1841bb5d5ebb34d852e6ead14912dadded3307d37 Jul 10 02:15:35.813326 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.813293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:35.880564 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:35.880487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:36.023761 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.023719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6ftl" event={"ID":"591496af-4920-4c51-b2f5-97a727d0eaef","Type":"ContainerStarted","Data":"cfb31c3aef5fbc157e190af1841bb5d5ebb34d852e6ead14912dadded3307d37"} Jul 10 02:15:36.068926 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.068895 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:15:36.167134 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.167049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:36.267150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.267115 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:36.474191 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.474062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:36.764787 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.764740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:36.847825 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:36.847779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:37.030204 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:37.030115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6ftl" event={"ID":"591496af-4920-4c51-b2f5-97a727d0eaef","Type":"ContainerStarted","Data":"b7af769eb8f268f4ff96c9199c53a6289b1e1ae4f747c2c7e75d50f8cc7101c5"} Jul 10 02:15:37.784618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:37.784585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:37.882598 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:37.882552 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:37.886320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:37.886297 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mctlk" Jul 10 02:15:38.036204 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.036129 2567 generic.go:356] "Generic (PLEG): container finished" podID="591496af-4920-4c51-b2f5-97a727d0eaef" containerID="b7af769eb8f268f4ff96c9199c53a6289b1e1ae4f747c2c7e75d50f8cc7101c5" exitCode=0 Jul 10 02:15:38.036204 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.036195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6ftl" event={"ID":"591496af-4920-4c51-b2f5-97a727d0eaef","Type":"ContainerDied","Data":"b7af769eb8f268f4ff96c9199c53a6289b1e1ae4f747c2c7e75d50f8cc7101c5"} Jul 10 02:15:38.206040 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.206007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:38.306178 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.306077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:38.586175 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.586053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:38.647294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:38.647261 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:39.042426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:39.042394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6ftl" event={"ID":"591496af-4920-4c51-b2f5-97a727d0eaef","Type":"ContainerStarted","Data":"f69b92db76463b93b7be9b175eb8d4c45294f98ffd09ff27111a39111c5c207b"} Jul 10 02:15:39.042836 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:39.042471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6ftl" event={"ID":"591496af-4920-4c51-b2f5-97a727d0eaef","Type":"ContainerStarted","Data":"4fcd83b944a2844e48c60e068964afb3ef5ef92d37694467da322a804e630613"} Jul 10 02:15:39.064267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:39.064214 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h6ftl" podStartSLOduration=3.871750677 podStartE2EDuration="5.064199534s" totalImagesPullingTime="1.114349612s" totalInitContainerRuntime="78.099245ms" isStatefulPod=true podCreationTimestamp="2026-07-10 02:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:39.06217957 +0000 UTC m=+98.122584595" watchObservedRunningTime="2026-07-10 02:15:39.064199534 +0000 UTC m=+98.124604558" Jul 10 02:15:39.479789 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:39.479697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:39.545171 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:39.545139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:40.055799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:40.055769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:40.156928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:40.156891 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:41.090075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:41.090025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:41.943202 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:41.943162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:44.137932 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.137886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:44.239127 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.239094 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:44.744143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.744109 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:15:44.746849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.746833 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.749439 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.749414 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 02:15:44.754319 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754291 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 02:15:44.754446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754339 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 02:15:44.754446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754348 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 02:15:44.754446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-csw28\"" Jul 10 02:15:44.754614 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 02:15:44.754614 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 02:15:44.754614 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.754510 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 02:15:44.758634 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.758599 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 02:15:44.759444 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.759423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:15:44.897784 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.897944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.897944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.897944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.897944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grxf\" (UniqueName: \"kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.898089 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.898089 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.897984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grxf\" (UniqueName: \"kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.998929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.999130 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.998988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.999552 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.999527 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.999857 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.999556 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.999857 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.999695 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:44.999986 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:44.999899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:45.001255 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.001226 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:45.001494 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.001472 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:45.007341 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.007320 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grxf\" (UniqueName: \"kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf\") pod \"console-fc8c64f9f-qb7qz\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:45.060617 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.060589 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:45.193532 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.193507 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:15:45.195824 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:15:45.195795 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca90e76_0d15_49e8_b9de_da430358c214.slice/crio-23ce48dd825b658dd91fc5d38c6e4e70ce667003e22e8dd27f753f51e796da29 WatchSource:0}: Error finding container 23ce48dd825b658dd91fc5d38c6e4e70ce667003e22e8dd27f753f51e796da29: Status 404 returned error can't find the container with id 23ce48dd825b658dd91fc5d38c6e4e70ce667003e22e8dd27f753f51e796da29 Jul 10 02:15:45.544174 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.544128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:45.600696 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:45.600614 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:46.069229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:46.069180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc8c64f9f-qb7qz" event={"ID":"fca90e76-0d15-49e8-b9de-da430358c214","Type":"ContainerStarted","Data":"23ce48dd825b658dd91fc5d38c6e4e70ce667003e22e8dd27f753f51e796da29"} Jul 10 02:15:48.077916 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:48.077883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc8c64f9f-qb7qz" event={"ID":"fca90e76-0d15-49e8-b9de-da430358c214","Type":"ContainerStarted","Data":"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d"} Jul 10 02:15:48.096180 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:48.096132 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc8c64f9f-qb7qz" podStartSLOduration=1.311106665 podStartE2EDuration="4.096115612s" totalImagesPullingTime="2.785008947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:15:48.095533183 +0000 UTC m=+107.155938227" watchObservedRunningTime="2026-07-10 02:15:48.096115612 +0000 UTC m=+107.156520637" Jul 10 02:15:49.144924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:49.144883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:50.748918 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:50.748876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:50.849577 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:50.849540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:54.478244 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:54.478199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:54.578019 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:54.577985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:55.061304 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.061267 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:55.061480 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.061339 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:55.066076 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.066052 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:55.107974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.107943 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:15:55.274305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.274272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:55.374875 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.374798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:55.473479 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:55.473437 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:56.109611 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:56.109577 2567 generic.go:356] "Generic (PLEG): container finished" podID="7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a" containerID="f2a4d2df2654167aeb80a8f5e6301075510984142d5a310fb939a8c10b0d2796" exitCode=0 Jul 10 02:15:56.110085 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:56.109670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" event={"ID":"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a","Type":"ContainerDied","Data":"f2a4d2df2654167aeb80a8f5e6301075510984142d5a310fb939a8c10b0d2796"} Jul 10 02:15:56.110130 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:56.110081 2567 scope.go:117] "RemoveContainer" containerID="f2a4d2df2654167aeb80a8f5e6301075510984142d5a310fb939a8c10b0d2796" Jul 10 02:15:57.115599 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:57.115562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-k9h6m" event={"ID":"7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a","Type":"ContainerStarted","Data":"92b559e607d7cb23f617b09736db7245d417052e8e691ee22d04a906b60f9c7a"} Jul 10 02:15:57.719566 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:57.719529 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:57.774258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:57.774228 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:15:58.180977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:58.180946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-2d4r8_7232669a-92fa-4b6b-a3e1-282cd60de248/cluster-monitoring-operator/0.log" Jul 10 02:15:59.977754 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:15:59.977726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/init-textfile/0.log" Jul 10 02:16:00.179370 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:00.179335 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/node-exporter/0.log" Jul 10 02:16:00.377987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:00.377953 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/kube-rbac-proxy/0.log" Jul 10 02:16:01.096504 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.096462 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" podUID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" containerName="registry" containerID="cri-o://d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87" gracePeriod=30 Jul 10 02:16:01.131945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.131918 2567 generic.go:356] "Generic (PLEG): container finished" podID="6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d" containerID="d5624a23afb19625775704e6bccefe037a392f08243b8a38755f9a0a17c1174b" exitCode=0 Jul 10 02:16:01.132068 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.131993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" event={"ID":"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d","Type":"ContainerDied","Data":"d5624a23afb19625775704e6bccefe037a392f08243b8a38755f9a0a17c1174b"} Jul 10 02:16:01.132372 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.132355 2567 scope.go:117] "RemoveContainer" containerID="d5624a23afb19625775704e6bccefe037a392f08243b8a38755f9a0a17c1174b" Jul 10 02:16:01.426210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.426181 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:16:01.539420 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539388 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539420 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539422 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539453 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539513 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539545 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539569 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539612 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.539927 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.539680 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttdx8\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8\") pod \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\" (UID: \"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c\") " Jul 10 02:16:01.540541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.540392 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:01.540747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.540639 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:01.542209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.542181 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:16:01.542209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.542196 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:16:01.542394 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.542353 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:16:01.542710 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.542678 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:16:01.542847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.542829 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8" (OuterVolumeSpecName: "kube-api-access-ttdx8") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "kube-api-access-ttdx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:16:01.548410 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.548385 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" (UID: "2d442226-3d4c-4aa7-bfa2-e05ff3a6007c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:16:01.641365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641267 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-tls\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641313 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-registry-certificates\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641330 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-ca-trust-extracted\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641343 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-bound-sa-token\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641358 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-image-registry-private-configuration\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641372 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-trusted-ca\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641385 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-installation-pull-secrets\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:01.641636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:01.641398 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttdx8\" (UniqueName: \"kubernetes.io/projected/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c-kube-api-access-ttdx8\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:02.136962 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.136920 2567 generic.go:356] "Generic (PLEG): container finished" podID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" containerID="d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87" exitCode=0 Jul 10 02:16:02.137426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.136982 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" Jul 10 02:16:02.137426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.136996 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" event={"ID":"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c","Type":"ContainerDied","Data":"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87"} Jul 10 02:16:02.137426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.137044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f5c6fc84d-6xlfx" event={"ID":"2d442226-3d4c-4aa7-bfa2-e05ff3a6007c","Type":"ContainerDied","Data":"96b7f37fd193751553e5f9aa2266042f9d6c923aa7cdbe84c6eb4e0111a7e329"} Jul 10 02:16:02.137426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.137075 2567 scope.go:117] "RemoveContainer" containerID="d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87" Jul 10 02:16:02.139072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.139044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-hj9jx" event={"ID":"6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d","Type":"ContainerStarted","Data":"3d0d17d0be419ff1c1da6f0cd04e93cdbb23fc42a3d33b31e7205732b391296a"} Jul 10 02:16:02.145919 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.145898 2567 scope.go:117] "RemoveContainer" containerID="d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87" Jul 10 02:16:02.146230 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:16:02.146205 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87\": container with ID starting with d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87 not found: ID does not exist" containerID="d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87" Jul 10 02:16:02.146317 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.146238 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87"} err="failed to get container status \"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87\": rpc error: code = NotFound desc = could not find container \"d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87\": container with ID starting with d59edab9d156ef5b2412b8a38216fd1ae9dc428f82a5c862e5d213cfea229d87 not found: ID does not exist" Jul 10 02:16:02.175242 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.175213 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:16:02.180769 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:02.180740 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f5c6fc84d-6xlfx"] Jul 10 02:16:03.019613 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.019583 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:03.093645 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.093612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:03.190080 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.190042 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:03.472166 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.472086 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" path="/var/lib/kubelet/pods/2d442226-3d4c-4aa7-bfa2-e05ff3a6007c/volumes" Jul 10 02:16:03.899462 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.899426 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:16:03.899923 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.899902 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" containerName="registry" Jul 10 02:16:03.899923 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.899924 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" containerName="registry" Jul 10 02:16:03.900091 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.900018 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d442226-3d4c-4aa7-bfa2-e05ff3a6007c" containerName="registry" Jul 10 02:16:03.908210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.908182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.916176 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.916148 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgwh\" (UniqueName: \"kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.958736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.958674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:03.965807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:03.965771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:04.059392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krgwh\" (UniqueName: \"kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059591 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.059891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.059695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.060438 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.060394 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.060634 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.060608 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.060807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.060693 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.060937 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.060698 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.062576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.062557 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.062698 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.062645 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.067914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.067889 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgwh\" (UniqueName: \"kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh\") pod \"console-78d9c955b-spjqh\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.166948 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.166862 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:04.218770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.218731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:04.264828 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.264782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:04.356044 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.356019 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:16:04.358814 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:16:04.358785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbffc2e2_3e02_4a2f_bf09_49023cd8d63a.slice/crio-61466fced2da39bfb02e0b144d6eb84efe3e52eaded1d047e642e2e386ed4823 WatchSource:0}: Error finding container 61466fced2da39bfb02e0b144d6eb84efe3e52eaded1d047e642e2e386ed4823: Status 404 returned error can't find the container with id 61466fced2da39bfb02e0b144d6eb84efe3e52eaded1d047e642e2e386ed4823 Jul 10 02:16:04.700577 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.700546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:04.761736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:04.761699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:05.059948 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.059912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:05.152767 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.152730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d9c955b-spjqh" event={"ID":"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a","Type":"ContainerStarted","Data":"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050"} Jul 10 02:16:05.152933 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.152790 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d9c955b-spjqh" event={"ID":"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a","Type":"ContainerStarted","Data":"61466fced2da39bfb02e0b144d6eb84efe3e52eaded1d047e642e2e386ed4823"} Jul 10 02:16:05.159708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.159679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:05.172201 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.172155 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d9c955b-spjqh" podStartSLOduration=2.172138814 podStartE2EDuration="2.172138814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:16:05.170001864 +0000 UTC m=+124.230406891" watchObservedRunningTime="2026-07-10 02:16:05.172138814 +0000 UTC m=+124.232543839" Jul 10 02:16:05.778023 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.777993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:16:05.983741 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:05.983712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/3.log" Jul 10 02:16:06.378877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:06.378848 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc8c64f9f-qb7qz_fca90e76-0d15-49e8-b9de-da430358c214/console/0.log" Jul 10 02:16:10.173320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.173287 2567 generic.go:356] "Generic (PLEG): container finished" podID="5f019e26-b91f-4f0d-b3f8-c9b4c83380b1" containerID="fac8a37882be942c248929c5427d8f8f3dadd78318b0fdd81c8f1b2dccbc938d" exitCode=0 Jul 10 02:16:10.173739 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.173364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" event={"ID":"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1","Type":"ContainerDied","Data":"fac8a37882be942c248929c5427d8f8f3dadd78318b0fdd81c8f1b2dccbc938d"} Jul 10 02:16:10.173803 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.173775 2567 scope.go:117] "RemoveContainer" containerID="fac8a37882be942c248929c5427d8f8f3dadd78318b0fdd81c8f1b2dccbc938d" Jul 10 02:16:10.311852 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.311811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:16:10.314352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.314324 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcf852c2-86fb-4722-9284-97be57533c80-metrics-certs\") pod \"network-metrics-daemon-b4mjq\" (UID: \"bcf852c2-86fb-4722-9284-97be57533c80\") " pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:16:10.386599 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.386527 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-htmn4\"" Jul 10 02:16:10.394784 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.394768 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b4mjq" Jul 10 02:16:10.554666 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:10.554618 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b4mjq"] Jul 10 02:16:10.557710 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:16:10.557684 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf852c2_86fb_4722_9284_97be57533c80.slice/crio-e29be343962c63f2c6a647ed1488fe2f3a58417c6887c4c40dc16a5ceec2c088 WatchSource:0}: Error finding container e29be343962c63f2c6a647ed1488fe2f3a58417c6887c4c40dc16a5ceec2c088: Status 404 returned error can't find the container with id e29be343962c63f2c6a647ed1488fe2f3a58417c6887c4c40dc16a5ceec2c088 Jul 10 02:16:11.178431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:11.178386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4mjq" event={"ID":"bcf852c2-86fb-4722-9284-97be57533c80","Type":"ContainerStarted","Data":"e29be343962c63f2c6a647ed1488fe2f3a58417c6887c4c40dc16a5ceec2c088"} Jul 10 02:16:11.180048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:11.180024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-zfrtl" event={"ID":"5f019e26-b91f-4f0d-b3f8-c9b4c83380b1","Type":"ContainerStarted","Data":"aec7d899dc19630b8733460a44c305961e0e400fdf783072e28a7e3f01179ed6"} Jul 10 02:16:12.185099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:12.185007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4mjq" event={"ID":"bcf852c2-86fb-4722-9284-97be57533c80","Type":"ContainerStarted","Data":"587c237ec5f9b755291d8a892277d207ba0b9102edc0bcc77a0257fa371eacf5"} Jul 10 02:16:12.185099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:12.185061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b4mjq" event={"ID":"bcf852c2-86fb-4722-9284-97be57533c80","Type":"ContainerStarted","Data":"19a826ef0aad184d9bd80c905513848eb583b3bae8c49251afef194a758d0999"} Jul 10 02:16:12.227143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:12.227087 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b4mjq" podStartSLOduration=128.903233808 podStartE2EDuration="2m10.227071546s" totalImagesPullingTime="1.323837738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:16:12.220067011 +0000 UTC m=+131.280472035" watchObservedRunningTime="2026-07-10 02:16:12.227071546 +0000 UTC m=+131.287476570" Jul 10 02:16:12.352852 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:12.352815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:12.430007 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:12.429974 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:14.219367 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:14.219330 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:14.219862 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:14.219402 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:14.223957 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:14.223935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:15.199832 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:15.199803 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:16:15.256327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:15.256286 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:16:15.393634 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:15.393603 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:15.497406 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:15.497315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:15.576314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:15.576272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:20.055673 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:20.055627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:20.118751 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:20.118719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:21.360210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:21.360159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:40.285526 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.285461 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fc8c64f9f-qb7qz" podUID="fca90e76-0d15-49e8-b9de-da430358c214" containerName="console" containerID="cri-o://f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d" gracePeriod=15 Jul 10 02:16:40.526457 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.526430 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:16:40.658358 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658282 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658358 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658322 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658358 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658355 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8grxf\" (UniqueName: \"kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658730 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658382 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658730 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658562 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658730 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658623 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658730 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658719 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert\") pod \"fca90e76-0d15-49e8-b9de-da430358c214\" (UID: \"fca90e76-0d15-49e8-b9de-da430358c214\") " Jul 10 02:16:40.658943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658768 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca" (OuterVolumeSpecName: "service-ca") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:40.658943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658855 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:40.659047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658972 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-oauth-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.659047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.658990 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-service-ca\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.659047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.659021 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:40.659364 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.659095 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config" (OuterVolumeSpecName: "console-config") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:16:40.660855 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.660834 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:16:40.660958 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.660855 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf" (OuterVolumeSpecName: "kube-api-access-8grxf") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "kube-api-access-8grxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:16:40.660958 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.660933 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fca90e76-0d15-49e8-b9de-da430358c214" (UID: "fca90e76-0d15-49e8-b9de-da430358c214"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:16:40.759422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.759391 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8grxf\" (UniqueName: \"kubernetes.io/projected/fca90e76-0d15-49e8-b9de-da430358c214-kube-api-access-8grxf\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.759422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.759416 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-trusted-ca-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.759422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.759428 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca90e76-0d15-49e8-b9de-da430358c214-console-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.759622 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.759439 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:40.759622 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:40.759449 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca90e76-0d15-49e8-b9de-da430358c214-console-oauth-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:16:41.293191 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.293158 2567 generic.go:356] "Generic (PLEG): container finished" podID="fca90e76-0d15-49e8-b9de-da430358c214" containerID="f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d" exitCode=0 Jul 10 02:16:41.293597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.293207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc8c64f9f-qb7qz" event={"ID":"fca90e76-0d15-49e8-b9de-da430358c214","Type":"ContainerDied","Data":"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d"} Jul 10 02:16:41.293597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.293218 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc8c64f9f-qb7qz" Jul 10 02:16:41.293597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.293255 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc8c64f9f-qb7qz" event={"ID":"fca90e76-0d15-49e8-b9de-da430358c214","Type":"ContainerDied","Data":"23ce48dd825b658dd91fc5d38c6e4e70ce667003e22e8dd27f753f51e796da29"} Jul 10 02:16:41.293597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.293278 2567 scope.go:117] "RemoveContainer" containerID="f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d" Jul 10 02:16:41.301748 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.301729 2567 scope.go:117] "RemoveContainer" containerID="f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d" Jul 10 02:16:41.302011 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:16:41.301992 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d\": container with ID starting with f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d not found: ID does not exist" containerID="f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d" Jul 10 02:16:41.302054 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.302020 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d"} err="failed to get container status \"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d\": rpc error: code = NotFound desc = could not find container \"f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d\": container with ID starting with f562cc3eea6045197fb05fec0ea9a933d0d10f71b0dac3eb63131ee4f9fd942d not found: ID does not exist" Jul 10 02:16:41.314066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.314046 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:16:41.319410 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.319392 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc8c64f9f-qb7qz"] Jul 10 02:16:41.471217 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:41.471188 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca90e76-0d15-49e8-b9de-da430358c214" path="/var/lib/kubelet/pods/fca90e76-0d15-49e8-b9de-da430358c214/volumes" Jul 10 02:16:50.946287 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:50.946254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:51.045370 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:51.045335 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:58.430770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.430688 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:16:58.431128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.430962 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca90e76-0d15-49e8-b9de-da430358c214" containerName="console" Jul 10 02:16:58.431128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.430973 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca90e76-0d15-49e8-b9de-da430358c214" containerName="console" Jul 10 02:16:58.431128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.431030 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca90e76-0d15-49e8-b9de-da430358c214" containerName="console" Jul 10 02:16:58.433983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.433960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.460747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.460709 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:16:58.499345 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499481 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499481 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499481 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lc66\" (UniqueName: \"kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.499636 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.499596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.509809 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.509779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:58.600716 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600679 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600716 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.600964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.600863 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lc66\" (UniqueName: \"kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.601569 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.601540 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.601681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.601549 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.601681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.601595 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.601810 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.601785 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.603467 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.603448 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.603528 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.603490 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.609195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.609173 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lc66\" (UniqueName: \"kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66\") pod \"console-6c4fd8dfc-29nqj\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.610313 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.610284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:16:58.743495 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.743408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:16:58.872289 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:58.872261 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:16:58.874776 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:16:58.874744 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48d2161_f638_4248_864b_a60d96c034d6.slice/crio-e193fc1a474a544e8d3b37572bad2676624daefd49babf6e3d3c98f8e3612f60 WatchSource:0}: Error finding container e193fc1a474a544e8d3b37572bad2676624daefd49babf6e3d3c98f8e3612f60: Status 404 returned error can't find the container with id e193fc1a474a544e8d3b37572bad2676624daefd49babf6e3d3c98f8e3612f60 Jul 10 02:16:59.361882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:59.361834 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fd8dfc-29nqj" event={"ID":"c48d2161-f638-4248-864b-a60d96c034d6","Type":"ContainerStarted","Data":"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b"} Jul 10 02:16:59.362079 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:59.361898 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fd8dfc-29nqj" event={"ID":"c48d2161-f638-4248-864b-a60d96c034d6","Type":"ContainerStarted","Data":"e193fc1a474a544e8d3b37572bad2676624daefd49babf6e3d3c98f8e3612f60"} Jul 10 02:16:59.380337 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:16:59.380298 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c4fd8dfc-29nqj" podStartSLOduration=1.380283399 podStartE2EDuration="1.380283399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:16:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:16:59.379399829 +0000 UTC m=+178.439804860" watchObservedRunningTime="2026-07-10 02:16:59.380283399 +0000 UTC m=+178.440688424" Jul 10 02:17:02.976194 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:02.976152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:03.031920 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:03.031893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:08.744143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:08.744099 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:17:08.744531 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:08.744170 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:17:08.748883 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:08.748860 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:17:09.401668 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:09.401627 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:17:09.448550 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:09.448521 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:17:09.551788 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:09.551752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:09.652214 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:09.652126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:09.714602 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:09.714566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:15.396200 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:15.396155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:20.064662 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:20.064620 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:20.164004 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:20.163968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:27.230596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:27.230556 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:34.472413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.472348 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78d9c955b-spjqh" podUID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" containerName="console" containerID="cri-o://ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050" gracePeriod=15 Jul 10 02:17:34.721900 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.721866 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:17:34.792729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792699 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792728 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792978 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792752 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792978 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792771 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792978 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792788 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792978 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792894 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krgwh\" (UniqueName: \"kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.792978 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.792937 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert\") pod \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\" (UID: \"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a\") " Jul 10 02:17:34.793227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.793159 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:17:34.793227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.793171 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:17:34.793227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.793196 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config" (OuterVolumeSpecName: "console-config") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:17:34.793368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.793283 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:17:34.795084 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.795055 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:17:34.795195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.795149 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh" (OuterVolumeSpecName: "kube-api-access-krgwh") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "kube-api-access-krgwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:17:34.795195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.795189 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" (UID: "cbffc2e2-3e02-4a2f-bf09-49023cd8d63a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:17:34.893563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893525 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-oauth-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893556 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-service-ca\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893567 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-trusted-ca-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893816 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893575 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-oauth-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893816 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893584 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893816 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893591 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krgwh\" (UniqueName: \"kubernetes.io/projected/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-kube-api-access-krgwh\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:34.893816 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:34.893600 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a-console-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:17:35.491232 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.491197 2567 generic.go:356] "Generic (PLEG): container finished" podID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" containerID="ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050" exitCode=0 Jul 10 02:17:35.491682 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.491250 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d9c955b-spjqh" Jul 10 02:17:35.491682 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.491279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d9c955b-spjqh" event={"ID":"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a","Type":"ContainerDied","Data":"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050"} Jul 10 02:17:35.491682 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.491327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d9c955b-spjqh" event={"ID":"cbffc2e2-3e02-4a2f-bf09-49023cd8d63a","Type":"ContainerDied","Data":"61466fced2da39bfb02e0b144d6eb84efe3e52eaded1d047e642e2e386ed4823"} Jul 10 02:17:35.491682 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.491346 2567 scope.go:117] "RemoveContainer" containerID="ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050" Jul 10 02:17:35.499378 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.499361 2567 scope.go:117] "RemoveContainer" containerID="ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050" Jul 10 02:17:35.499633 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:17:35.499614 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050\": container with ID starting with ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050 not found: ID does not exist" containerID="ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050" Jul 10 02:17:35.499728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.499642 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050"} err="failed to get container status \"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050\": rpc error: code = NotFound desc = could not find container \"ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050\": container with ID starting with ad121455f4caa0b385053b067a7729db3f35764fdcf28c5caf2c70b4ed8ee050 not found: ID does not exist" Jul 10 02:17:35.508039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.508016 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:17:35.513198 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:35.513176 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d9c955b-spjqh"] Jul 10 02:17:37.472764 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:37.472732 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" path="/var/lib/kubelet/pods/cbffc2e2-3e02-4a2f-bf09-49023cd8d63a/volumes" Jul 10 02:17:55.896003 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:55.895960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:55.989805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:55.989769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:17:56.612025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.611990 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln"] Jul 10 02:17:56.612274 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.612261 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" containerName="console" Jul 10 02:17:56.612316 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.612275 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" containerName="console" Jul 10 02:17:56.612346 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.612326 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbffc2e2-3e02-4a2f-bf09-49023cd8d63a" containerName="console" Jul 10 02:17:56.615315 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.615298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.617841 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.617815 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 02:17:56.617841 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.617832 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 02:17:56.618756 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.618739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zsdf\"" Jul 10 02:17:56.624047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.624025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln"] Jul 10 02:17:56.670261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.670233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49mc\" (UniqueName: \"kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.670433 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.670304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.670433 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.670386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.771268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.771233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.771389 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.771286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.771389 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.771314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49mc\" (UniqueName: \"kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.771611 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.771592 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.771742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.771703 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.779987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.779957 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49mc\" (UniqueName: \"kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:56.925327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:56.925230 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:17:57.058545 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:57.058511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln"] Jul 10 02:17:57.062307 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:17:57.062270 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65b0d01_6e36_4ac2_9f75_14f19b6d037a.slice/crio-24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607 WatchSource:0}: Error finding container 24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607: Status 404 returned error can't find the container with id 24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607 Jul 10 02:17:57.573936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:17:57.573894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" event={"ID":"b65b0d01-6e36-4ac2-9f75-14f19b6d037a","Type":"ContainerStarted","Data":"24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607"} Jul 10 02:18:04.602398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:04.602366 2567 generic.go:356] "Generic (PLEG): container finished" podID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerID="c9339063396baca30e856aed10757d4125b82a3b0842c43a5d41eb33744ae105" exitCode=0 Jul 10 02:18:04.602829 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:04.602469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" event={"ID":"b65b0d01-6e36-4ac2-9f75-14f19b6d037a","Type":"ContainerDied","Data":"c9339063396baca30e856aed10757d4125b82a3b0842c43a5d41eb33744ae105"} Jul 10 02:18:07.616209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:07.616173 2567 generic.go:356] "Generic (PLEG): container finished" podID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerID="99889520faffeef9834b9b4fbc8769298a3780eaa9a75e0fc9c250ceeaa47b58" exitCode=0 Jul 10 02:18:07.616580 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:07.616253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" event={"ID":"b65b0d01-6e36-4ac2-9f75-14f19b6d037a","Type":"ContainerDied","Data":"99889520faffeef9834b9b4fbc8769298a3780eaa9a75e0fc9c250ceeaa47b58"} Jul 10 02:18:16.663666 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:16.663608 2567 generic.go:356] "Generic (PLEG): container finished" podID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerID="2460fb81c1cb4ee068fa5d5cfd0c1547fc195a5a359fac79a8b6efecd431fb89" exitCode=0 Jul 10 02:18:16.664116 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:16.663706 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" event={"ID":"b65b0d01-6e36-4ac2-9f75-14f19b6d037a","Type":"ContainerDied","Data":"2460fb81c1cb4ee068fa5d5cfd0c1547fc195a5a359fac79a8b6efecd431fb89"} Jul 10 02:18:17.792400 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.792378 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:18:17.847206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.847170 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle\") pod \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " Jul 10 02:18:17.847376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.847232 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x49mc\" (UniqueName: \"kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc\") pod \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " Jul 10 02:18:17.847376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.847260 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util\") pod \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\" (UID: \"b65b0d01-6e36-4ac2-9f75-14f19b6d037a\") " Jul 10 02:18:17.848016 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.847984 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle" (OuterVolumeSpecName: "bundle") pod "b65b0d01-6e36-4ac2-9f75-14f19b6d037a" (UID: "b65b0d01-6e36-4ac2-9f75-14f19b6d037a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:17.849663 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.849632 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc" (OuterVolumeSpecName: "kube-api-access-x49mc") pod "b65b0d01-6e36-4ac2-9f75-14f19b6d037a" (UID: "b65b0d01-6e36-4ac2-9f75-14f19b6d037a"). InnerVolumeSpecName "kube-api-access-x49mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:18:17.851457 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.851437 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util" (OuterVolumeSpecName: "util") pod "b65b0d01-6e36-4ac2-9f75-14f19b6d037a" (UID: "b65b0d01-6e36-4ac2-9f75-14f19b6d037a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:17.948573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.948487 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:17.948573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.948521 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:17.948573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:17.948530 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x49mc\" (UniqueName: \"kubernetes.io/projected/b65b0d01-6e36-4ac2-9f75-14f19b6d037a-kube-api-access-x49mc\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:18.673273 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:18.673231 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" event={"ID":"b65b0d01-6e36-4ac2-9f75-14f19b6d037a","Type":"ContainerDied","Data":"24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607"} Jul 10 02:18:18.673431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:18.673277 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jnsln" Jul 10 02:18:18.673431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:18.673288 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24232d707a87ee05d78a543a4e6252074941d17240cdf44c06f2a11b57247607" Jul 10 02:18:22.646168 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:22.646118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:23.604567 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:23.604512 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:24.586405 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586372 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9"] Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586632 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="pull" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586641 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="pull" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586667 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="util" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586673 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="util" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586688 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="extract" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586693 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="extract" Jul 10 02:18:24.586779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.586744 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65b0d01-6e36-4ac2-9f75-14f19b6d037a" containerName="extract" Jul 10 02:18:24.589525 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.589511 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.592109 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.592085 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4mpsm\"" Jul 10 02:18:24.592228 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.592124 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 02:18:24.592228 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.592125 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:18:24.601725 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.601705 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9"] Jul 10 02:18:24.701001 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.700971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kvz\" (UniqueName: \"kubernetes.io/projected/322eb71c-7648-4676-b638-8bc10a454fc0-kube-api-access-d4kvz\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.701165 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.701037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322eb71c-7648-4676-b638-8bc10a454fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.801491 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.801459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322eb71c-7648-4676-b638-8bc10a454fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.801677 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.801498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kvz\" (UniqueName: \"kubernetes.io/projected/322eb71c-7648-4676-b638-8bc10a454fc0-kube-api-access-d4kvz\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.801902 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.801883 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/322eb71c-7648-4676-b638-8bc10a454fc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.812706 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.812683 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kvz\" (UniqueName: \"kubernetes.io/projected/322eb71c-7648-4676-b638-8bc10a454fc0-kube-api-access-d4kvz\") pod \"cert-manager-operator-controller-manager-55c444bf86-bvkm9\" (UID: \"322eb71c-7648-4676-b638-8bc10a454fc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:24.898376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:24.898289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" Jul 10 02:18:25.034084 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:25.034051 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9"] Jul 10 02:18:25.037921 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:18:25.037892 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322eb71c_7648_4676_b638_8bc10a454fc0.slice/crio-283722fc96f6b1440fe27337db24a50699df469b0e9bda39d721780e4d1b5f5b WatchSource:0}: Error finding container 283722fc96f6b1440fe27337db24a50699df469b0e9bda39d721780e4d1b5f5b: Status 404 returned error can't find the container with id 283722fc96f6b1440fe27337db24a50699df469b0e9bda39d721780e4d1b5f5b Jul 10 02:18:25.700143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:25.700109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" event={"ID":"322eb71c-7648-4676-b638-8bc10a454fc0","Type":"ContainerStarted","Data":"283722fc96f6b1440fe27337db24a50699df469b0e9bda39d721780e4d1b5f5b"} Jul 10 02:18:26.265983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:26.265944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:26.365944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:26.365908 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:27.711020 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.710985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" event={"ID":"322eb71c-7648-4676-b638-8bc10a454fc0","Type":"ContainerStarted","Data":"4314f7f613f315a0ddf26e68cb13bc62071dd5e007272d775c07a30fd5edac5d"} Jul 10 02:18:27.733556 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.733499 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bvkm9" podStartSLOduration=1.884955401 podStartE2EDuration="3.733476028s" totalImagesPullingTime="1.848520627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:18:27.732718152 +0000 UTC m=+266.793123187" watchObservedRunningTime="2026-07-10 02:18:27.733476028 +0000 UTC m=+266.793881048" Jul 10 02:18:27.816067 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.816031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:27.918055 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.918013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:27.924837 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.924811 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-748pc"] Jul 10 02:18:27.928031 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.928015 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:27.930743 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.930715 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 02:18:27.930743 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.930716 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 02:18:27.930976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.930742 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9s7dw\"" Jul 10 02:18:27.939004 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:27.938977 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-748pc"] Jul 10 02:18:28.031420 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.031385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwkh\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-kube-api-access-zwwkh\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.031588 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.031428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.082182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.082153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:28.132528 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.132499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwkh\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-kube-api-access-zwwkh\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.132718 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.132533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.150069 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.150042 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwkh\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-kube-api-access-zwwkh\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.155640 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.155619 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/662258c1-024b-432e-b12c-5e8bcd383a2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-748pc\" (UID: \"662258c1-024b-432e-b12c-5e8bcd383a2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.191968 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.191938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:28.256792 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.256761 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:28.401676 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.401636 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-748pc"] Jul 10 02:18:28.403716 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:18:28.403682 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod662258c1_024b_432e_b12c_5e8bcd383a2b.slice/crio-d79498315e396658fdf3a09ad25e42d7d16818bdaeeb822f74c82817d5a204a8 WatchSource:0}: Error finding container d79498315e396658fdf3a09ad25e42d7d16818bdaeeb822f74c82817d5a204a8: Status 404 returned error can't find the container with id d79498315e396658fdf3a09ad25e42d7d16818bdaeeb822f74c82817d5a204a8 Jul 10 02:18:28.715855 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.715777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" event={"ID":"662258c1-024b-432e-b12c-5e8bcd383a2b","Type":"ContainerStarted","Data":"d79498315e396658fdf3a09ad25e42d7d16818bdaeeb822f74c82817d5a204a8"} Jul 10 02:18:28.907663 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.907619 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82"] Jul 10 02:18:28.912147 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.912129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:28.914625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.914608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 02:18:28.915540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.915524 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zsdf\"" Jul 10 02:18:28.915621 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.915550 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 02:18:28.923780 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:28.923763 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82"] Jul 10 02:18:29.039590 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.039559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bsvm\" (UniqueName: \"kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.039747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.039603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.039747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.039682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.140345 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.140309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.140490 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.140366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bsvm\" (UniqueName: \"kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.140490 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.140401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.140819 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.140799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.140819 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.140807 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.151559 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.151532 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bsvm\" (UniqueName: \"kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.221836 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.221806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:29.377689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.377665 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82"] Jul 10 02:18:29.379952 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:18:29.379921 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe09646_ea7f_4db6_8095_a3db172fe1db.slice/crio-6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23 WatchSource:0}: Error finding container 6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23: Status 404 returned error can't find the container with id 6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23 Jul 10 02:18:29.722289 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.722201 2567 generic.go:356] "Generic (PLEG): container finished" podID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerID="9c73208ead844d351d81297a41315d9f49cc06a791ef582ad34af47a63161163" exitCode=0 Jul 10 02:18:29.722289 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.722253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" event={"ID":"dfe09646-ea7f-4db6-8095-a3db172fe1db","Type":"ContainerDied","Data":"9c73208ead844d351d81297a41315d9f49cc06a791ef582ad34af47a63161163"} Jul 10 02:18:29.722805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:29.722295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" event={"ID":"dfe09646-ea7f-4db6-8095-a3db172fe1db","Type":"ContainerStarted","Data":"6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23"} Jul 10 02:18:30.015693 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:30.015602 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:30.631490 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:30.631448 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:32.738013 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:32.737976 2567 generic.go:356] "Generic (PLEG): container finished" podID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerID="0519a8c355184294d6650b99a50651fbcf67338cd8016a7ede0834efd8aebe78" exitCode=0 Jul 10 02:18:32.738405 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:32.738080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" event={"ID":"dfe09646-ea7f-4db6-8095-a3db172fe1db","Type":"ContainerDied","Data":"0519a8c355184294d6650b99a50651fbcf67338cd8016a7ede0834efd8aebe78"} Jul 10 02:18:32.739792 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:32.739736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" event={"ID":"662258c1-024b-432e-b12c-5e8bcd383a2b","Type":"ContainerStarted","Data":"5e89fd2f20e7984fccfdac59c2d10e7a4bd97254957c42cc3f406ca5aa7a09cc"} Jul 10 02:18:32.739899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:32.739827 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:32.774574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:32.774520 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" podStartSLOduration=2.194105311 podStartE2EDuration="5.774500467s" totalImagesPullingTime="3.580395156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:18:32.772101068 +0000 UTC m=+271.832506104" watchObservedRunningTime="2026-07-10 02:18:32.774500467 +0000 UTC m=+271.834905492" Jul 10 02:18:33.059453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:33.059413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:33.118022 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:33.117988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:33.745566 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:33.745536 2567 generic.go:356] "Generic (PLEG): container finished" podID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerID="827ad0abe2da1680c59e785ff82d8d3b52bbc6a4b3d1ce38ba7acd61049c6c2f" exitCode=0 Jul 10 02:18:33.745979 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:33.745631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" event={"ID":"dfe09646-ea7f-4db6-8095-a3db172fe1db","Type":"ContainerDied","Data":"827ad0abe2da1680c59e785ff82d8d3b52bbc6a4b3d1ce38ba7acd61049c6c2f"} Jul 10 02:18:34.873760 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.873738 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:34.995712 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.995683 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bsvm\" (UniqueName: \"kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm\") pod \"dfe09646-ea7f-4db6-8095-a3db172fe1db\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " Jul 10 02:18:34.995882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.995753 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util\") pod \"dfe09646-ea7f-4db6-8095-a3db172fe1db\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " Jul 10 02:18:34.995882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.995789 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle\") pod \"dfe09646-ea7f-4db6-8095-a3db172fe1db\" (UID: \"dfe09646-ea7f-4db6-8095-a3db172fe1db\") " Jul 10 02:18:34.996198 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.996175 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle" (OuterVolumeSpecName: "bundle") pod "dfe09646-ea7f-4db6-8095-a3db172fe1db" (UID: "dfe09646-ea7f-4db6-8095-a3db172fe1db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:34.997967 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:34.997946 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm" (OuterVolumeSpecName: "kube-api-access-2bsvm") pod "dfe09646-ea7f-4db6-8095-a3db172fe1db" (UID: "dfe09646-ea7f-4db6-8095-a3db172fe1db"). InnerVolumeSpecName "kube-api-access-2bsvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:18:35.000487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.000465 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util" (OuterVolumeSpecName: "util") pod "dfe09646-ea7f-4db6-8095-a3db172fe1db" (UID: "dfe09646-ea7f-4db6-8095-a3db172fe1db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:35.097019 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.096930 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:35.097019 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.096960 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfe09646-ea7f-4db6-8095-a3db172fe1db-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:35.097019 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.096970 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bsvm\" (UniqueName: \"kubernetes.io/projected/dfe09646-ea7f-4db6-8095-a3db172fe1db-kube-api-access-2bsvm\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:35.757830 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.757797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" event={"ID":"dfe09646-ea7f-4db6-8095-a3db172fe1db","Type":"ContainerDied","Data":"6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23"} Jul 10 02:18:35.757970 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.757843 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cf6cf688dee14a89d85ca493299820d8a921fce422af69be66b0bba7b648a23" Jul 10 02:18:35.757970 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:35.757804 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbmn82" Jul 10 02:18:38.440108 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:38.440070 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:38.748312 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:38.748233 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-748pc" Jul 10 02:18:40.734806 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:40.734773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:41.921920 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:41.921864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:42.764847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.764815 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt"] Jul 10 02:18:42.765116 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765103 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="util" Jul 10 02:18:42.765159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765118 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="util" Jul 10 02:18:42.765159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765128 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="pull" Jul 10 02:18:42.765159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765133 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="pull" Jul 10 02:18:42.765159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765144 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="extract" Jul 10 02:18:42.765159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765150 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="extract" Jul 10 02:18:42.766272 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.765620 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe09646-ea7f-4db6-8095-a3db172fe1db" containerName="extract" Jul 10 02:18:42.775926 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.775901 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:42.779032 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.779011 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 02:18:42.779174 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.779010 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p95s5\"" Jul 10 02:18:42.779249 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.779020 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 02:18:42.779565 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.779545 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt"] Jul 10 02:18:42.965833 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.965795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7qqg\" (UniqueName: \"kubernetes.io/projected/c2c67d76-9561-409d-8e10-cf8f0d44c54c-kube-api-access-l7qqg\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:42.966216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:42.965842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2c67d76-9561-409d-8e10-cf8f0d44c54c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.066562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.066479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7qqg\" (UniqueName: \"kubernetes.io/projected/c2c67d76-9561-409d-8e10-cf8f0d44c54c-kube-api-access-l7qqg\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.066562 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.066532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2c67d76-9561-409d-8e10-cf8f0d44c54c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.066968 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.066921 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2c67d76-9561-409d-8e10-cf8f0d44c54c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.076268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.076234 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7qqg\" (UniqueName: \"kubernetes.io/projected/c2c67d76-9561-409d-8e10-cf8f0d44c54c-kube-api-access-l7qqg\") pod \"openshift-lws-operator-fd8ccff4c-68vrt\" (UID: \"c2c67d76-9561-409d-8e10-cf8f0d44c54c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.085933 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.085914 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" Jul 10 02:18:43.225357 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.225325 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt"] Jul 10 02:18:43.228797 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:18:43.228768 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2c67d76_9561_409d_8e10_cf8f0d44c54c.slice/crio-9368440e5a796a86ee79491fe8ed98440c8c9e2882040d57c1e28ea14b70609a WatchSource:0}: Error finding container 9368440e5a796a86ee79491fe8ed98440c8c9e2882040d57c1e28ea14b70609a: Status 404 returned error can't find the container with id 9368440e5a796a86ee79491fe8ed98440c8c9e2882040d57c1e28ea14b70609a Jul 10 02:18:43.791330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:43.791287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" event={"ID":"c2c67d76-9561-409d-8e10-cf8f0d44c54c","Type":"ContainerStarted","Data":"9368440e5a796a86ee79491fe8ed98440c8c9e2882040d57c1e28ea14b70609a"} Jul 10 02:18:45.803294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:45.803258 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" event={"ID":"c2c67d76-9561-409d-8e10-cf8f0d44c54c","Type":"ContainerStarted","Data":"085b5247a796b30c0fc47134086408cc20083ecac40ab9ece5caeda4cec9d6b2"} Jul 10 02:18:45.829406 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:45.829339 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-68vrt" podStartSLOduration=1.608396658 podStartE2EDuration="3.829319901s" totalImagesPullingTime="2.220923243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:18:45.828623036 +0000 UTC m=+284.889028060" watchObservedRunningTime="2026-07-10 02:18:45.829319901 +0000 UTC m=+284.889724925" Jul 10 02:18:46.570126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:46.570089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:46.664840 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:46.664809 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:48.392517 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.392483 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn"] Jul 10 02:18:48.413329 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.413301 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn"] Jul 10 02:18:48.413480 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.413408 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.418429 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.418409 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 02:18:48.418942 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.418922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5zsdf\"" Jul 10 02:18:48.418942 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.418932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 02:18:48.510028 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.510000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.510194 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.510059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5snt\" (UniqueName: \"kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.510194 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.510087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.559011 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.558979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:48.611216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.611183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.611371 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.611248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5snt\" (UniqueName: \"kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.611371 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.611279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.611573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.611558 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.611683 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.611619 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.624698 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.624667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5snt\" (UniqueName: \"kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.723348 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.723259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:48.858880 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:48.858850 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn"] Jul 10 02:18:48.861825 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:18:48.861788 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5010dba8_9ac1_4794_83f3_c4ebc917b577.slice/crio-bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b WatchSource:0}: Error finding container bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b: Status 404 returned error can't find the container with id bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b Jul 10 02:18:49.821487 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:49.821452 2567 generic.go:356] "Generic (PLEG): container finished" podID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerID="0e8af61d48c9813c727ff89e046c8b3c3f131e728a0adc15995f69ea613a9954" exitCode=0 Jul 10 02:18:49.821885 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:49.821533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" event={"ID":"5010dba8-9ac1-4794-83f3-c4ebc917b577","Type":"ContainerDied","Data":"0e8af61d48c9813c727ff89e046c8b3c3f131e728a0adc15995f69ea613a9954"} Jul 10 02:18:49.821885 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:49.821584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" event={"ID":"5010dba8-9ac1-4794-83f3-c4ebc917b577","Type":"ContainerStarted","Data":"bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b"} Jul 10 02:18:50.827700 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:50.827642 2567 generic.go:356] "Generic (PLEG): container finished" podID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerID="89df2dd3d4f1c61250092b3205283b19dbd98675f415cc5e8621c6f978c95b0a" exitCode=0 Jul 10 02:18:50.827700 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:50.827683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" event={"ID":"5010dba8-9ac1-4794-83f3-c4ebc917b577","Type":"ContainerDied","Data":"89df2dd3d4f1c61250092b3205283b19dbd98675f415cc5e8621c6f978c95b0a"} Jul 10 02:18:51.834984 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:51.834939 2567 generic.go:356] "Generic (PLEG): container finished" podID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerID="0ab614fb2d4996d6025c47608ed7fa452f5a2b4ef259887175d91b8e63cc4ee7" exitCode=0 Jul 10 02:18:51.835424 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:51.835024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" event={"ID":"5010dba8-9ac1-4794-83f3-c4ebc917b577","Type":"ContainerDied","Data":"0ab614fb2d4996d6025c47608ed7fa452f5a2b4ef259887175d91b8e63cc4ee7"} Jul 10 02:18:52.974485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:52.974461 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:53.037006 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.036974 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle\") pod \"5010dba8-9ac1-4794-83f3-c4ebc917b577\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " Jul 10 02:18:53.037714 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.037692 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle" (OuterVolumeSpecName: "bundle") pod "5010dba8-9ac1-4794-83f3-c4ebc917b577" (UID: "5010dba8-9ac1-4794-83f3-c4ebc917b577"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:53.137462 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.137385 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util\") pod \"5010dba8-9ac1-4794-83f3-c4ebc917b577\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " Jul 10 02:18:53.137579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.137516 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5snt\" (UniqueName: \"kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt\") pod \"5010dba8-9ac1-4794-83f3-c4ebc917b577\" (UID: \"5010dba8-9ac1-4794-83f3-c4ebc917b577\") " Jul 10 02:18:53.137736 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.137719 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:53.139852 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.139816 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt" (OuterVolumeSpecName: "kube-api-access-q5snt") pod "5010dba8-9ac1-4794-83f3-c4ebc917b577" (UID: "5010dba8-9ac1-4794-83f3-c4ebc917b577"). InnerVolumeSpecName "kube-api-access-q5snt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:18:53.143258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.143234 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util" (OuterVolumeSpecName: "util") pod "5010dba8-9ac1-4794-83f3-c4ebc917b577" (UID: "5010dba8-9ac1-4794-83f3-c4ebc917b577"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:18:53.238694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.238640 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5010dba8-9ac1-4794-83f3-c4ebc917b577-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:53.238694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.238690 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5snt\" (UniqueName: \"kubernetes.io/projected/5010dba8-9ac1-4794-83f3-c4ebc917b577-kube-api-access-q5snt\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:18:53.846137 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.846106 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" Jul 10 02:18:53.846370 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.846105 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89ljn" event={"ID":"5010dba8-9ac1-4794-83f3-c4ebc917b577","Type":"ContainerDied","Data":"bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b"} Jul 10 02:18:53.846370 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:53.846227 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd9363dfcd6a56119d108b4863148451c8a7296b4dec3d1dc1f5e9806df76d4b" Jul 10 02:18:54.191103 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:54.191014 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:18:54.247995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:18:54.247964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:00.308366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:00.308324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:00.412062 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:00.412021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:00.924463 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:00.924424 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.179176 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.179066 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.279081 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.279039 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.297941 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.297901 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m"] Jul 10 02:19:01.298550 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298526 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="util" Jul 10 02:19:01.298550 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298553 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="util" Jul 10 02:19:01.298742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298577 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="extract" Jul 10 02:19:01.298742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298586 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="extract" Jul 10 02:19:01.298742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298605 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="pull" Jul 10 02:19:01.298742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298613 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="pull" Jul 10 02:19:01.298936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.298785 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5010dba8-9ac1-4794-83f3-c4ebc917b577" containerName="extract" Jul 10 02:19:01.303009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.302987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.305595 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.305572 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 02:19:01.305728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.305604 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 02:19:01.305728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.305604 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 02:19:01.305728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.305696 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p8792\"" Jul 10 02:19:01.305871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.305786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 02:19:01.316783 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.316757 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m"] Jul 10 02:19:01.378330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.378300 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:19:01.381445 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.381416 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:19:01.390717 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.390698 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 02:19:01.401380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.401358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.401496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.401390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-manifests\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.401496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.401414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqhhf\" (UniqueName: \"kubernetes.io/projected/1bf3055d-75ff-4968-8871-a1ea877493f5-kube-api-access-cqhhf\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.401496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.401484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.401603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.401517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-tmp\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.458118 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.457937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.502828 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.502793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.503013 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.502845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-manifests\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.503082 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.503046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhhf\" (UniqueName: \"kubernetes.io/projected/1bf3055d-75ff-4968-8871-a1ea877493f5-kube-api-access-cqhhf\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.503160 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.503098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.503160 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.503136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-tmp\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.503270 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.503237 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-manifests\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.505450 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.505430 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf3055d-75ff-4968-8871-a1ea877493f5-tmp\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.505767 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.505749 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 02:19:01.511835 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.511816 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 02:19:01.516180 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.516155 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.516180 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.516172 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf3055d-75ff-4968-8871-a1ea877493f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.522056 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.522034 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 02:19:01.532227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.532206 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqhhf\" (UniqueName: \"kubernetes.io/projected/1bf3055d-75ff-4968-8871-a1ea877493f5-kube-api-access-cqhhf\") pod \"opendatahub-operator-controller-manager-94f6fbcc5-6527m\" (UID: \"1bf3055d-75ff-4968-8871-a1ea877493f5\") " pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.549543 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.549514 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.616387 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.616354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p8792\"" Jul 10 02:19:01.624381 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.624351 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:01.649540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.649505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.755853 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.755823 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.768269 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.768241 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m"] Jul 10 02:19:01.771337 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:01.771314 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf3055d_75ff_4968_8871_a1ea877493f5.slice/crio-bc79a582fca43a662ac6114a3d369305036e9a99dda87bc5bb9e058e657ce77b WatchSource:0}: Error finding container bc79a582fca43a662ac6114a3d369305036e9a99dda87bc5bb9e058e657ce77b: Status 404 returned error can't find the container with id bc79a582fca43a662ac6114a3d369305036e9a99dda87bc5bb9e058e657ce77b Jul 10 02:19:01.853064 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.853021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:01.881585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:01.881546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" event={"ID":"1bf3055d-75ff-4968-8871-a1ea877493f5","Type":"ContainerStarted","Data":"bc79a582fca43a662ac6114a3d369305036e9a99dda87bc5bb9e058e657ce77b"} Jul 10 02:19:05.906245 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:05.906201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" event={"ID":"1bf3055d-75ff-4968-8871-a1ea877493f5","Type":"ContainerStarted","Data":"a6030fc4ce3f90ef4ddde3ae997dd74dde4daf56a42d6c85a2b4d3721b170e15"} Jul 10 02:19:06.912341 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:06.912301 2567 generic.go:356] "Generic (PLEG): container finished" podID="1bf3055d-75ff-4968-8871-a1ea877493f5" containerID="a6030fc4ce3f90ef4ddde3ae997dd74dde4daf56a42d6c85a2b4d3721b170e15" exitCode=0 Jul 10 02:19:06.912803 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:06.912386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" event={"ID":"1bf3055d-75ff-4968-8871-a1ea877493f5","Type":"ContainerDied","Data":"a6030fc4ce3f90ef4ddde3ae997dd74dde4daf56a42d6c85a2b4d3721b170e15"} Jul 10 02:19:06.912879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:06.912865 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 02:19:07.919058 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:07.919019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" event={"ID":"1bf3055d-75ff-4968-8871-a1ea877493f5","Type":"ContainerStarted","Data":"386369f7dc0c00e041b99f06b7c350b1d97809799f62c38f07ad6fe72a68c9f2"} Jul 10 02:19:07.919448 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:07.919227 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:07.941935 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:07.941887 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" podStartSLOduration=2.188239363 podStartE2EDuration="6.941869802s" totalImagesPullingTime="3.746678686s" totalInitContainerRuntime="1.006951753s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:07.940514771 +0000 UTC m=+307.000919806" watchObservedRunningTime="2026-07-10 02:19:07.941869802 +0000 UTC m=+307.002274827" Jul 10 02:19:08.722810 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:08.722771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:14.746988 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:14.746944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:14.860913 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:14.860875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:17.340121 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:17.340085 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:18.925713 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:18.925682 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94f6fbcc5-6527m" Jul 10 02:19:20.483944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:20.483909 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:20.587295 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:20.587256 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:20.797967 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:20.797935 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:20.962719 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:20.962684 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.119402 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.119325 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-779d665c94-fvd42"] Jul 10 02:19:21.146513 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.146474 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779d665c94-fvd42"] Jul 10 02:19:21.146724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.146569 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.149541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.149517 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 02:19:21.149882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.149858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 02:19:21.150732 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.150709 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wwzv9\"" Jul 10 02:19:21.259248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.259217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edb7fb69-f6e0-4781-8b2e-111929b252fb-tmp\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.259403 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.259256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7tm\" (UniqueName: \"kubernetes.io/projected/edb7fb69-f6e0-4781-8b2e-111929b252fb-kube-api-access-hz7tm\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.259403 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.259276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb7fb69-f6e0-4781-8b2e-111929b252fb-tls-certs\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.360023 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.359991 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edb7fb69-f6e0-4781-8b2e-111929b252fb-tmp\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.360023 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.360029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7tm\" (UniqueName: \"kubernetes.io/projected/edb7fb69-f6e0-4781-8b2e-111929b252fb-kube-api-access-hz7tm\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.360223 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.360052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb7fb69-f6e0-4781-8b2e-111929b252fb-tls-certs\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.362386 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.362353 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edb7fb69-f6e0-4781-8b2e-111929b252fb-tmp\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.362518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.362493 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edb7fb69-f6e0-4781-8b2e-111929b252fb-tls-certs\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.378677 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.378585 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7tm\" (UniqueName: \"kubernetes.io/projected/edb7fb69-f6e0-4781-8b2e-111929b252fb-kube-api-access-hz7tm\") pod \"kube-auth-proxy-779d665c94-fvd42\" (UID: \"edb7fb69-f6e0-4781-8b2e-111929b252fb\") " pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.456924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.456891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" Jul 10 02:19:21.465319 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.465287 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96d2v"] Jul 10 02:19:21.471083 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.471058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.473621 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.473601 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 10 02:19:21.473748 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.473675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fnwgj\"" Jul 10 02:19:21.481469 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.481446 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96d2v"] Jul 10 02:19:21.514762 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.514635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.562264 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.562231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgdh\" (UniqueName: \"kubernetes.io/projected/fbd63e21-8a3f-4292-b159-60ea573c20b4-kube-api-access-2cgdh\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.562418 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.562380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.583377 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.583330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.596312 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.596290 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779d665c94-fvd42"] Jul 10 02:19:21.598932 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:21.598875 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb7fb69_f6e0_4781_8b2e_111929b252fb.slice/crio-ce6a99c613ea25a7cb8d886ad8129e785d5e3c388dd65ff28180cfea795010a7 WatchSource:0}: Error finding container ce6a99c613ea25a7cb8d886ad8129e785d5e3c388dd65ff28180cfea795010a7: Status 404 returned error can't find the container with id ce6a99c613ea25a7cb8d886ad8129e785d5e3c388dd65ff28180cfea795010a7 Jul 10 02:19:21.663075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.662974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.663075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.663032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgdh\" (UniqueName: \"kubernetes.io/projected/fbd63e21-8a3f-4292-b159-60ea573c20b4-kube-api-access-2cgdh\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.663269 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:19:21.663147 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 10 02:19:21.663269 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:19:21.663216 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert podName:fbd63e21-8a3f-4292-b159-60ea573c20b4 nodeName:}" failed. No retries permitted until 2026-07-10 02:19:22.163200346 +0000 UTC m=+321.223605351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert") pod "odh-model-controller-7998c67dc4-96d2v" (UID: "fbd63e21-8a3f-4292-b159-60ea573c20b4") : secret "odh-model-controller-webhook-cert" not found Jul 10 02:19:21.671302 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.671275 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgdh\" (UniqueName: \"kubernetes.io/projected/fbd63e21-8a3f-4292-b159-60ea573c20b4-kube-api-access-2cgdh\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:21.687324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.687253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.818795 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.818756 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.907141 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.907100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:21.980486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:21.980397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" event={"ID":"edb7fb69-f6e0-4781-8b2e-111929b252fb","Type":"ContainerStarted","Data":"ce6a99c613ea25a7cb8d886ad8129e785d5e3c388dd65ff28180cfea795010a7"} Jul 10 02:19:22.167977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.167940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:22.170423 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.170404 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd63e21-8a3f-4292-b159-60ea573c20b4-cert\") pod \"odh-model-controller-7998c67dc4-96d2v\" (UID: \"fbd63e21-8a3f-4292-b159-60ea573c20b4\") " pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:22.318446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.318410 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:22.321174 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.321155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.323628 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.323610 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 02:19:22.323766 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.323745 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 02:19:22.323826 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.323800 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-55fqv\"" Jul 10 02:19:22.324268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.324158 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 02:19:22.324268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.324259 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 02:19:22.324401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.324265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:22.336818 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.336787 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:22.369940 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.369912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.369986 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370072 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.370051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.370092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.370155 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370284 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.370200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.370284 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.370226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpcc\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.391899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.391874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:22.399621 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.399594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:22.471075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471980 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpcc\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.471980 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.471316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.472163 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.472142 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.474131 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.474111 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.474263 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.474232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.474426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.474405 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.474579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.474555 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.486504 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.486475 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.486644 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.486478 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpcc\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc\") pod \"istiod-openshift-gateway-7574459656-29v92\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.500187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.500153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:22.541254 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.541229 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96d2v"] Jul 10 02:19:22.543609 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:22.543576 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd63e21_8a3f_4292_b159_60ea573c20b4.slice/crio-5dd031ee69213d1c991add6d759301a48f2ca98ef528e9d5c16d8003fa034569 WatchSource:0}: Error finding container 5dd031ee69213d1c991add6d759301a48f2ca98ef528e9d5c16d8003fa034569: Status 404 returned error can't find the container with id 5dd031ee69213d1c991add6d759301a48f2ca98ef528e9d5c16d8003fa034569 Jul 10 02:19:22.631633 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.631543 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:22.786261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.786233 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:22.790767 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:22.790708 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1912fc52_a0f6_4997_940e_857950da346a.slice/crio-8e01a1871e2b80870230d304da9c65dfab5bf6b58be82a0f36fc0c17d41d1816 WatchSource:0}: Error finding container 8e01a1871e2b80870230d304da9c65dfab5bf6b58be82a0f36fc0c17d41d1816: Status 404 returned error can't find the container with id 8e01a1871e2b80870230d304da9c65dfab5bf6b58be82a0f36fc0c17d41d1816 Jul 10 02:19:22.991822 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.991716 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" event={"ID":"1912fc52-a0f6-4997-940e-857950da346a","Type":"ContainerStarted","Data":"8e01a1871e2b80870230d304da9c65dfab5bf6b58be82a0f36fc0c17d41d1816"} Jul 10 02:19:22.992863 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:22.992838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" event={"ID":"fbd63e21-8a3f-4292-b159-60ea573c20b4","Type":"ContainerStarted","Data":"5dd031ee69213d1c991add6d759301a48f2ca98ef528e9d5c16d8003fa034569"} Jul 10 02:19:23.085987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:23.085944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:23.449491 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:23.449407 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:26.990555 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:26.990416 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 02:19:26.990555 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:26.990530 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 10 02:19:28.019330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.019292 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" event={"ID":"edb7fb69-f6e0-4781-8b2e-111929b252fb","Type":"ContainerStarted","Data":"fa6fbc005a36cf6a5964369571ac8a998af8a9dd0740160606f675aa5032dfce"} Jul 10 02:19:28.020934 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.020900 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" event={"ID":"1912fc52-a0f6-4997-940e-857950da346a","Type":"ContainerStarted","Data":"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e"} Jul 10 02:19:28.021120 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.021102 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:28.022866 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.022841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" event={"ID":"fbd63e21-8a3f-4292-b159-60ea573c20b4","Type":"ContainerStarted","Data":"ac87829ce55ce55c78729e0bd2100110369407abecbcbde277a8cb40764d8719"} Jul 10 02:19:28.023028 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.022986 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:19:28.023163 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.023143 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-29v92 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 02:19:28.023227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.023196 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 02:19:28.038665 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.038611 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-779d665c94-fvd42" podStartSLOduration=1.655343459 podStartE2EDuration="7.038597985s" totalImagesPullingTime="5.383254526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:28.037073127 +0000 UTC m=+327.097478153" watchObservedRunningTime="2026-07-10 02:19:28.038597985 +0000 UTC m=+327.099003009" Jul 10 02:19:28.054690 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.054626 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" podStartSLOduration=2.5636043969999998 podStartE2EDuration="7.054613241s" totalImagesPullingTime="4.491008844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:28.053587764 +0000 UTC m=+327.113992800" watchObservedRunningTime="2026-07-10 02:19:28.054613241 +0000 UTC m=+327.115018267" Jul 10 02:19:28.074427 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.074391 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" podStartSLOduration=1.878047303 podStartE2EDuration="6.074378197s" totalImagesPullingTime="4.196330894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:28.073051403 +0000 UTC m=+327.133456442" watchObservedRunningTime="2026-07-10 02:19:28.074378197 +0000 UTC m=+327.134783221" Jul 10 02:19:28.407240 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.407102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:28.502870 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:28.502836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:29.028193 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:29.028162 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-29v92 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 02:19:29.028578 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:29.028223 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 02:19:29.163902 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:29.163863 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:29.422599 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:29.422487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:29.506610 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:29.506577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:32.028615 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.028582 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:32.058179 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.058141 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:32.120977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.120945 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz"] Jul 10 02:19:32.124376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.124358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.126891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.126863 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 10 02:19:32.126891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.126892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g6sjw\"" Jul 10 02:19:32.135122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.134095 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22"] Jul 10 02:19:32.135122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.134985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:32.137407 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.137381 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz"] Jul 10 02:19:32.137515 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.137483 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.140821 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.140796 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nbzz9\"" Jul 10 02:19:32.140936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.140875 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 10 02:19:32.151709 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.151686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22"] Jul 10 02:19:32.260203 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.260175 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.260395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.260210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh2dt\" (UniqueName: \"kubernetes.io/projected/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-kube-api-access-sh2dt\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.260395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.260244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td62j\" (UniqueName: \"kubernetes.io/projected/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-kube-api-access-td62j\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.260395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.260273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.302175 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.302089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:32.361161 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.361130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.361324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.361162 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh2dt\" (UniqueName: \"kubernetes.io/projected/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-kube-api-access-sh2dt\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.361324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.361198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td62j\" (UniqueName: \"kubernetes.io/projected/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-kube-api-access-td62j\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.361324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.361250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.363689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.363663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.363807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.363755 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.386075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.386054 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh2dt\" (UniqueName: \"kubernetes.io/projected/d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0-kube-api-access-sh2dt\") pod \"kserve-controller-manager-d6f4b65b8-hxzmz\" (UID: \"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.386192 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.386148 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td62j\" (UniqueName: \"kubernetes.io/projected/b23d7992-505a-4d8a-8a42-cfb78c19a9cc-kube-api-access-td62j\") pod \"llmisvc-controller-manager-777c6bd7d5-swc22\" (UID: \"b23d7992-505a-4d8a-8a42-cfb78c19a9cc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.389227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.389203 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:32.435201 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.435172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:32.451151 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.449191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:32.587982 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.587771 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz"] Jul 10 02:19:32.591342 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:32.591293 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3db7cbe_dfdb_4e25_a1d6_a93d729aa4c0.slice/crio-c632c61f89a49f6311f061676f6ec25c7ce6d35dea1b55e14c2da845431cad53 WatchSource:0}: Error finding container c632c61f89a49f6311f061676f6ec25c7ce6d35dea1b55e14c2da845431cad53: Status 404 returned error can't find the container with id c632c61f89a49f6311f061676f6ec25c7ce6d35dea1b55e14c2da845431cad53 Jul 10 02:19:32.620168 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:32.620144 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22"] Jul 10 02:19:32.622610 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:19:32.622586 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb23d7992_505a_4d8a_8a42_cfb78c19a9cc.slice/crio-92ad7fc7d2f899a4bf008d036fd0bba99667b769251239038583a3f6af9d019e WatchSource:0}: Error finding container 92ad7fc7d2f899a4bf008d036fd0bba99667b769251239038583a3f6af9d019e: Status 404 returned error can't find the container with id 92ad7fc7d2f899a4bf008d036fd0bba99667b769251239038583a3f6af9d019e Jul 10 02:19:33.053031 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:33.052995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" event={"ID":"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0","Type":"ContainerStarted","Data":"c632c61f89a49f6311f061676f6ec25c7ce6d35dea1b55e14c2da845431cad53"} Jul 10 02:19:33.054205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:33.054178 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" event={"ID":"b23d7992-505a-4d8a-8a42-cfb78c19a9cc","Type":"ContainerStarted","Data":"92ad7fc7d2f899a4bf008d036fd0bba99667b769251239038583a3f6af9d019e"} Jul 10 02:19:33.354693 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:33.354586 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:33.466355 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:33.466317 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:33.561530 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:33.561310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:19:34.981063 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:34.981030 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:34.981458 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:34.981263 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" containerID="cri-o://6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e" gracePeriod=30 Jul 10 02:19:35.028813 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.028779 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-29v92 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:8080/ready\": dial tcp 10.132.0.32:8080: connect: connection refused" start-of-body= Jul 10 02:19:35.028992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.028858 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.32:8080/ready\": dial tcp 10.132.0.32:8080: connect: connection refused" Jul 10 02:19:35.728383 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.728354 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:35.794826 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.794793 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.794977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.794857 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.794977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.794876 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.794977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.794899 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnpcc\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.794977 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.794944 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.795205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.795096 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.795205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.795164 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token\") pod \"1912fc52-a0f6-4997-940e-857950da346a\" (UID: \"1912fc52-a0f6-4997-940e-857950da346a\") " Jul 10 02:19:35.795584 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.795517 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:19:35.797362 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797335 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:19:35.797362 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797357 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts" (OuterVolumeSpecName: "cacerts") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:19:35.797617 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797593 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:19:35.797794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797632 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc" (OuterVolumeSpecName: "kube-api-access-jnpcc") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "kube-api-access-jnpcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:19:35.797794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797764 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs" (OuterVolumeSpecName: "local-certs") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:19:35.797903 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.797884 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1912fc52-a0f6-4997-940e-857950da346a" (UID: "1912fc52-a0f6-4997-940e-857950da346a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:19:35.896308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896277 2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-kubeconfig\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896307 2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1912fc52-a0f6-4997-940e-857950da346a-local-certs\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896316 2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-dns-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896325 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnpcc\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-kube-api-access-jnpcc\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896334 2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1912fc52-a0f6-4997-940e-857950da346a-cacerts\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896342 2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1912fc52-a0f6-4997-940e-857950da346a-istio-csr-ca-configmap\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:35.896518 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:35.896351 2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1912fc52-a0f6-4997-940e-857950da346a-istio-token\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:19:36.073338 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.073243 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" event={"ID":"d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0","Type":"ContainerStarted","Data":"24c68344d495dcabb2ae0eac966acb025cfff449787f5760f6ba87e35bc09234"} Jul 10 02:19:36.073338 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.073332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:19:36.074899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.074871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" event={"ID":"b23d7992-505a-4d8a-8a42-cfb78c19a9cc","Type":"ContainerStarted","Data":"70878c540493b86ab179a5572b14f7a96189410c418bc4d41f6478655172dc00"} Jul 10 02:19:36.075048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.075000 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:19:36.076182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.076156 2567 generic.go:356] "Generic (PLEG): container finished" podID="1912fc52-a0f6-4997-940e-857950da346a" containerID="6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e" exitCode=0 Jul 10 02:19:36.076292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.076195 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" Jul 10 02:19:36.076292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.076228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" event={"ID":"1912fc52-a0f6-4997-940e-857950da346a","Type":"ContainerDied","Data":"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e"} Jul 10 02:19:36.076292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.076268 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-29v92" event={"ID":"1912fc52-a0f6-4997-940e-857950da346a","Type":"ContainerDied","Data":"8e01a1871e2b80870230d304da9c65dfab5bf6b58be82a0f36fc0c17d41d1816"} Jul 10 02:19:36.076292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.076289 2567 scope.go:117] "RemoveContainer" containerID="6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e" Jul 10 02:19:36.091688 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.091548 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" podStartSLOduration=1.553529323 podStartE2EDuration="4.091529962s" totalImagesPullingTime="2.538000639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:36.090632886 +0000 UTC m=+335.151037909" watchObservedRunningTime="2026-07-10 02:19:36.091529962 +0000 UTC m=+335.151934988" Jul 10 02:19:36.092198 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.092174 2567 scope.go:117] "RemoveContainer" containerID="6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e" Jul 10 02:19:36.092598 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:19:36.092571 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e\": container with ID starting with 6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e not found: ID does not exist" containerID="6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e" Jul 10 02:19:36.092852 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.092815 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e"} err="failed to get container status \"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e\": rpc error: code = NotFound desc = could not find container \"6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e\": container with ID starting with 6ae59d7cace19d85b04f23bb59ec02b9fe6ff837724fb4611a64f869b822815e not found: ID does not exist" Jul 10 02:19:36.110835 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.110788 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" podStartSLOduration=0.995310914 podStartE2EDuration="4.110774165s" totalImagesPullingTime="3.115463251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:19:36.108290253 +0000 UTC m=+335.168695298" watchObservedRunningTime="2026-07-10 02:19:36.110774165 +0000 UTC m=+335.171179190" Jul 10 02:19:36.126133 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.126096 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:36.130549 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:36.130523 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-29v92"] Jul 10 02:19:37.473564 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:37.473532 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1912fc52-a0f6-4997-940e-857950da346a" path="/var/lib/kubelet/pods/1912fc52-a0f6-4997-940e-857950da346a/volumes" Jul 10 02:19:39.030116 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:19:39.030087 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-96d2v" Jul 10 02:20:07.084531 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:07.084493 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-swc22" Jul 10 02:20:07.087944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:07.087920 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hxzmz" Jul 10 02:20:22.087694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.087618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:22.196574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.196544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:22.258876 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.258846 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:22.259183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.259170 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" Jul 10 02:20:22.259229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.259185 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" Jul 10 02:20:22.259262 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.259241 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1912fc52-a0f6-4997-940e-857950da346a" containerName="discovery" Jul 10 02:20:22.272450 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.272412 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:22.272611 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.272595 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:22.275229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.275201 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 02:20:22.276118 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.276055 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 02:20:22.276243 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.276160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vpgsd\"" Jul 10 02:20:22.312574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.312538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:22.398401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.398315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrbc\" (UniqueName: \"kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc\") pod \"kuadrant-operator-catalog-htwdc\" (UID: \"8a8e4d6b-3d0a-4500-aba3-f949e8398948\") " pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:22.499705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.499672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrbc\" (UniqueName: \"kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc\") pod \"kuadrant-operator-catalog-htwdc\" (UID: \"8a8e4d6b-3d0a-4500-aba3-f949e8398948\") " pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:22.511392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.511362 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrbc\" (UniqueName: \"kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc\") pod \"kuadrant-operator-catalog-htwdc\" (UID: \"8a8e4d6b-3d0a-4500-aba3-f949e8398948\") " pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:22.583278 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.583245 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:22.600951 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.600663 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:22.714305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.714275 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:22.717112 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:22.717081 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8e4d6b_3d0a_4500_aba3_f949e8398948.slice/crio-388a6fc74ac7cfa8dbbe504b829f02c3f20d6ed71f90c41bae16b0bfff64bec5 WatchSource:0}: Error finding container 388a6fc74ac7cfa8dbbe504b829f02c3f20d6ed71f90c41bae16b0bfff64bec5: Status 404 returned error can't find the container with id 388a6fc74ac7cfa8dbbe504b829f02c3f20d6ed71f90c41bae16b0bfff64bec5 Jul 10 02:20:22.811062 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.811022 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m2r8l"] Jul 10 02:20:22.815729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.815712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:22.823554 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.823531 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m2r8l"] Jul 10 02:20:22.903245 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:22.903209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwqc\" (UniqueName: \"kubernetes.io/projected/63b5903f-05f4-40ae-abe7-243c89c0eabd-kube-api-access-4nwqc\") pod \"kuadrant-operator-catalog-m2r8l\" (UID: \"63b5903f-05f4-40ae-abe7-243c89c0eabd\") " pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:23.004251 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.004219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwqc\" (UniqueName: \"kubernetes.io/projected/63b5903f-05f4-40ae-abe7-243c89c0eabd-kube-api-access-4nwqc\") pod \"kuadrant-operator-catalog-m2r8l\" (UID: \"63b5903f-05f4-40ae-abe7-243c89c0eabd\") " pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:23.015342 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.015312 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwqc\" (UniqueName: \"kubernetes.io/projected/63b5903f-05f4-40ae-abe7-243c89c0eabd-kube-api-access-4nwqc\") pod \"kuadrant-operator-catalog-m2r8l\" (UID: \"63b5903f-05f4-40ae-abe7-243c89c0eabd\") " pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:23.033921 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.033882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:23.125642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.125610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:23.245431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.245395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:23.275322 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.275246 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m2r8l"] Jul 10 02:20:23.291491 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:23.291458 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b5903f_05f4_40ae_abe7_243c89c0eabd.slice/crio-26b9f7b8aaad421baf06afaddf6c5c32aabadd1792e1068404cf9ad7a5644285 WatchSource:0}: Error finding container 26b9f7b8aaad421baf06afaddf6c5c32aabadd1792e1068404cf9ad7a5644285: Status 404 returned error can't find the container with id 26b9f7b8aaad421baf06afaddf6c5c32aabadd1792e1068404cf9ad7a5644285 Jul 10 02:20:23.299365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.299341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" event={"ID":"63b5903f-05f4-40ae-abe7-243c89c0eabd","Type":"ContainerStarted","Data":"26b9f7b8aaad421baf06afaddf6c5c32aabadd1792e1068404cf9ad7a5644285"} Jul 10 02:20:23.300448 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:23.300421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" event={"ID":"8a8e4d6b-3d0a-4500-aba3-f949e8398948","Type":"ContainerStarted","Data":"388a6fc74ac7cfa8dbbe504b829f02c3f20d6ed71f90c41bae16b0bfff64bec5"} Jul 10 02:20:25.311498 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.311459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" event={"ID":"8a8e4d6b-3d0a-4500-aba3-f949e8398948","Type":"ContainerStarted","Data":"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf"} Jul 10 02:20:25.311970 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.311511 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" podUID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" containerName="registry-server" containerID="cri-o://9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf" gracePeriod=2 Jul 10 02:20:25.312990 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.312953 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" event={"ID":"63b5903f-05f4-40ae-abe7-243c89c0eabd","Type":"ContainerStarted","Data":"738edb3d8493ea49aa9a39f28d2d5b1fc2c98181533c2210e1e0095fa3eb466d"} Jul 10 02:20:25.327512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.327472 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" podStartSLOduration=1.362154979 podStartE2EDuration="3.327459133s" totalImagesPullingTime="1.965304154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:20:25.326178616 +0000 UTC m=+384.386583669" watchObservedRunningTime="2026-07-10 02:20:25.327459133 +0000 UTC m=+384.387864157" Jul 10 02:20:25.342207 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.342151 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" podStartSLOduration=1.95042168 podStartE2EDuration="3.342134511s" totalImagesPullingTime="1.391712831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:20:25.341223729 +0000 UTC m=+384.401628755" watchObservedRunningTime="2026-07-10 02:20:25.342134511 +0000 UTC m=+384.402539537" Jul 10 02:20:25.579757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.579722 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:25.728567 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.728528 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkrbc\" (UniqueName: \"kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc\") pod \"8a8e4d6b-3d0a-4500-aba3-f949e8398948\" (UID: \"8a8e4d6b-3d0a-4500-aba3-f949e8398948\") " Jul 10 02:20:25.730849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.730825 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc" (OuterVolumeSpecName: "kube-api-access-fkrbc") pod "8a8e4d6b-3d0a-4500-aba3-f949e8398948" (UID: "8a8e4d6b-3d0a-4500-aba3-f949e8398948"). InnerVolumeSpecName "kube-api-access-fkrbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:20:25.829587 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:25.829509 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkrbc\" (UniqueName: \"kubernetes.io/projected/8a8e4d6b-3d0a-4500-aba3-f949e8398948-kube-api-access-fkrbc\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:26.318974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.318942 2567 generic.go:356] "Generic (PLEG): container finished" podID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" containerID="9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf" exitCode=0 Jul 10 02:20:26.319431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.318991 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" Jul 10 02:20:26.319431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.319035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" event={"ID":"8a8e4d6b-3d0a-4500-aba3-f949e8398948","Type":"ContainerDied","Data":"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf"} Jul 10 02:20:26.319431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.319096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-htwdc" event={"ID":"8a8e4d6b-3d0a-4500-aba3-f949e8398948","Type":"ContainerDied","Data":"388a6fc74ac7cfa8dbbe504b829f02c3f20d6ed71f90c41bae16b0bfff64bec5"} Jul 10 02:20:26.319431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.319138 2567 scope.go:117] "RemoveContainer" containerID="9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf" Jul 10 02:20:26.328567 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.328551 2567 scope.go:117] "RemoveContainer" containerID="9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf" Jul 10 02:20:26.328828 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:20:26.328812 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf\": container with ID starting with 9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf not found: ID does not exist" containerID="9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf" Jul 10 02:20:26.328884 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.328835 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf"} err="failed to get container status \"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf\": rpc error: code = NotFound desc = could not find container \"9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf\": container with ID starting with 9ba27ccbfbed344850d98872dbebff9425ade8acaf95f848ac1e50eb969861bf not found: ID does not exist" Jul 10 02:20:26.339935 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.339911 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:26.343216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:26.343196 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-htwdc"] Jul 10 02:20:27.473551 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:27.473517 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" path="/var/lib/kubelet/pods/8a8e4d6b-3d0a-4500-aba3-f949e8398948/volumes" Jul 10 02:20:33.126170 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:33.126131 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:33.126625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:33.126205 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:33.149261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:33.149232 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:33.377739 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:33.377667 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m2r8l" Jul 10 02:20:38.053054 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.053021 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92"] Jul 10 02:20:38.053421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.053354 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" containerName="registry-server" Jul 10 02:20:38.053421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.053364 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" containerName="registry-server" Jul 10 02:20:38.053500 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.053431 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8e4d6b-3d0a-4500-aba3-f949e8398948" containerName="registry-server" Jul 10 02:20:38.057759 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.057743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.060047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.060025 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7ttbp\"" Jul 10 02:20:38.064864 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.064541 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92"] Jul 10 02:20:38.132829 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.132802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.133003 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.132864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2c29\" (UniqueName: \"kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.133003 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.132941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.233804 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.233764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.233974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.233823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2c29\" (UniqueName: \"kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.233974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.233864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.234161 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.234140 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.234205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.234166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.242139 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.242112 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2c29\" (UniqueName: \"kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.368065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.367976 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:38.500588 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.500566 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92"] Jul 10 02:20:38.502789 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:38.502759 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46871f35_5ec2_4d6f_90ca_4417727da86d.slice/crio-882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996 WatchSource:0}: Error finding container 882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996: Status 404 returned error can't find the container with id 882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996 Jul 10 02:20:38.649297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.649229 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m"] Jul 10 02:20:38.652677 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.652629 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.661131 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.661106 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m"] Jul 10 02:20:38.738604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.738569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5vc\" (UniqueName: \"kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.738604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.738608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.738867 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.738698 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.839295 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.839255 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.839470 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.839324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5vc\" (UniqueName: \"kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.839470 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.839355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.839705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.839681 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.839791 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.839759 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.847618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.847594 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5vc\" (UniqueName: \"kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:38.976293 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:38.976200 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:39.047274 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.047242 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm"] Jul 10 02:20:39.051855 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.051830 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.066998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.064118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm"] Jul 10 02:20:39.121007 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.120982 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m"] Jul 10 02:20:39.122938 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:39.122910 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0c72b7_ab02_404f_ad66_a47034697f6c.slice/crio-cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67 WatchSource:0}: Error finding container cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67: Status 404 returned error can't find the container with id cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67 Jul 10 02:20:39.141519 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.141490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.141616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.141549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.141686 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.141618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7nt\" (UniqueName: \"kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.242845 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.242781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.242845 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.242818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.242845 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.242842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7nt\" (UniqueName: \"kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.243236 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.243211 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.243283 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.243268 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.251183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.251158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7nt\" (UniqueName: \"kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.363548 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.363511 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:39.384743 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.384713 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerID="e0d4f4ca78ede4253fa9fae1d07e7e9f6074b5861d40fc2514fdd7e0df4c552f" exitCode=0 Jul 10 02:20:39.384893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.384794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" event={"ID":"3c0c72b7-ab02-404f-ad66-a47034697f6c","Type":"ContainerDied","Data":"e0d4f4ca78ede4253fa9fae1d07e7e9f6074b5861d40fc2514fdd7e0df4c552f"} Jul 10 02:20:39.384893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.384850 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" event={"ID":"3c0c72b7-ab02-404f-ad66-a47034697f6c","Type":"ContainerStarted","Data":"cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67"} Jul 10 02:20:39.387349 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.387314 2567 generic.go:356] "Generic (PLEG): container finished" podID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerID="c84beddffa6b3ae3b5a863db80bdd715a0d60ed6de64a6999f3a27661e1d5640" exitCode=0 Jul 10 02:20:39.387466 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.387354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" event={"ID":"46871f35-5ec2-4d6f-90ca-4417727da86d","Type":"ContainerDied","Data":"c84beddffa6b3ae3b5a863db80bdd715a0d60ed6de64a6999f3a27661e1d5640"} Jul 10 02:20:39.387466 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.387400 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" event={"ID":"46871f35-5ec2-4d6f-90ca-4417727da86d","Type":"ContainerStarted","Data":"882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996"} Jul 10 02:20:39.458233 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.458204 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp"] Jul 10 02:20:39.463740 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.463720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.475807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.475775 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp"] Jul 10 02:20:39.507017 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.506990 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm"] Jul 10 02:20:39.509039 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:39.509015 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093b8d59_ff26_4f71_ba04_739b6ab129d0.slice/crio-37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd WatchSource:0}: Error finding container 37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd: Status 404 returned error can't find the container with id 37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd Jul 10 02:20:39.546262 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.546232 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q87c2\" (UniqueName: \"kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.546398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.546335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.546398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.546377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.647247 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.647215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q87c2\" (UniqueName: \"kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.647392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.647290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.647392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.647326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.647703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.647682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.647748 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.647732 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.655826 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.655806 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q87c2\" (UniqueName: \"kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.777912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.777821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:39.913865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:39.913837 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp"] Jul 10 02:20:39.930586 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:39.930555 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba78049_d65e_46aa_acb4_2617c6d16b05.slice/crio-44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3 WatchSource:0}: Error finding container 44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3: Status 404 returned error can't find the container with id 44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3 Jul 10 02:20:40.394995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.394965 2567 generic.go:356] "Generic (PLEG): container finished" podID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerID="8b007f02ca2b648179ea75580804018037837e8f0570d34de05924c3e6340ac3" exitCode=0 Jul 10 02:20:40.395400 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.395047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" event={"ID":"46871f35-5ec2-4d6f-90ca-4417727da86d","Type":"ContainerDied","Data":"8b007f02ca2b648179ea75580804018037837e8f0570d34de05924c3e6340ac3"} Jul 10 02:20:40.396947 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.396924 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerID="60746b2982b94b1e3ea4b5f70ad7658b4cafa4bf585dc67e1328e14cbd81a721" exitCode=0 Jul 10 02:20:40.397023 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.397005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" event={"ID":"3c0c72b7-ab02-404f-ad66-a47034697f6c","Type":"ContainerDied","Data":"60746b2982b94b1e3ea4b5f70ad7658b4cafa4bf585dc67e1328e14cbd81a721"} Jul 10 02:20:40.398544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.398525 2567 generic.go:356] "Generic (PLEG): container finished" podID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerID="2cf272ed6f4fe6542a52622c48e17f62e037f39d475d49e890cea68d0d1dec5d" exitCode=0 Jul 10 02:20:40.398641 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.398611 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerDied","Data":"2cf272ed6f4fe6542a52622c48e17f62e037f39d475d49e890cea68d0d1dec5d"} Jul 10 02:20:40.398726 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.398692 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerStarted","Data":"44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3"} Jul 10 02:20:40.400202 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.400184 2567 generic.go:356] "Generic (PLEG): container finished" podID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerID="a5e9b74e3c2b5c6432d682052ba9ac1d3329d84caa9303a82db0878d17101851" exitCode=0 Jul 10 02:20:40.400261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.400216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" event={"ID":"093b8d59-ff26-4f71-ba04-739b6ab129d0","Type":"ContainerDied","Data":"a5e9b74e3c2b5c6432d682052ba9ac1d3329d84caa9303a82db0878d17101851"} Jul 10 02:20:40.400261 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:40.400250 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" event={"ID":"093b8d59-ff26-4f71-ba04-739b6ab129d0","Type":"ContainerStarted","Data":"37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd"} Jul 10 02:20:41.407912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.407879 2567 generic.go:356] "Generic (PLEG): container finished" podID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerID="c8d793d3686b9b6c8d3cc3742510fe18735810ba3ce12351ae958fd2449d6f17" exitCode=0 Jul 10 02:20:41.408318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.407958 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" event={"ID":"093b8d59-ff26-4f71-ba04-739b6ab129d0","Type":"ContainerDied","Data":"c8d793d3686b9b6c8d3cc3742510fe18735810ba3ce12351ae958fd2449d6f17"} Jul 10 02:20:41.416402 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.416371 2567 generic.go:356] "Generic (PLEG): container finished" podID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerID="da79b9f85f6583fbcca4b1d082ab67ea4817d4ce22827f7f774c610f0a5c8681" exitCode=0 Jul 10 02:20:41.416564 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.416540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" event={"ID":"46871f35-5ec2-4d6f-90ca-4417727da86d","Type":"ContainerDied","Data":"da79b9f85f6583fbcca4b1d082ab67ea4817d4ce22827f7f774c610f0a5c8681"} Jul 10 02:20:41.419634 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.419607 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerID="0e3bfe418077aef56a3ad3e95987a49e87766114cdadfccd7ab6fb81bd035fc6" exitCode=0 Jul 10 02:20:41.419814 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.419696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" event={"ID":"3c0c72b7-ab02-404f-ad66-a47034697f6c","Type":"ContainerDied","Data":"0e3bfe418077aef56a3ad3e95987a49e87766114cdadfccd7ab6fb81bd035fc6"} Jul 10 02:20:41.421947 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:41.421907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerStarted","Data":"6665f8ec3fdd9725013327a91115c9e8ef462f888eed3648a72d5faae4b19803"} Jul 10 02:20:42.428544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.428510 2567 generic.go:356] "Generic (PLEG): container finished" podID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerID="6665f8ec3fdd9725013327a91115c9e8ef462f888eed3648a72d5faae4b19803" exitCode=0 Jul 10 02:20:42.428973 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.428602 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerDied","Data":"6665f8ec3fdd9725013327a91115c9e8ef462f888eed3648a72d5faae4b19803"} Jul 10 02:20:42.430928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.430898 2567 generic.go:356] "Generic (PLEG): container finished" podID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerID="fa596e0dd9318292c17b26d159ea3966ddd4a68ad65d49290a3fa81fe43acb4b" exitCode=0 Jul 10 02:20:42.431032 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.430986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" event={"ID":"093b8d59-ff26-4f71-ba04-739b6ab129d0","Type":"ContainerDied","Data":"fa596e0dd9318292c17b26d159ea3966ddd4a68ad65d49290a3fa81fe43acb4b"} Jul 10 02:20:42.638540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.638518 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:42.641041 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.641022 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:42.776990 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.776951 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util\") pod \"46871f35-5ec2-4d6f-90ca-4417727da86d\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " Jul 10 02:20:42.777150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777010 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f5vc\" (UniqueName: \"kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc\") pod \"3c0c72b7-ab02-404f-ad66-a47034697f6c\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " Jul 10 02:20:42.777150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777032 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util\") pod \"3c0c72b7-ab02-404f-ad66-a47034697f6c\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " Jul 10 02:20:42.777150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777076 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2c29\" (UniqueName: \"kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29\") pod \"46871f35-5ec2-4d6f-90ca-4417727da86d\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " Jul 10 02:20:42.777150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777097 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle\") pod \"46871f35-5ec2-4d6f-90ca-4417727da86d\" (UID: \"46871f35-5ec2-4d6f-90ca-4417727da86d\") " Jul 10 02:20:42.777150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle\") pod \"3c0c72b7-ab02-404f-ad66-a47034697f6c\" (UID: \"3c0c72b7-ab02-404f-ad66-a47034697f6c\") " Jul 10 02:20:42.777675 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.777622 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle" (OuterVolumeSpecName: "bundle") pod "46871f35-5ec2-4d6f-90ca-4417727da86d" (UID: "46871f35-5ec2-4d6f-90ca-4417727da86d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:42.778057 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.778026 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle" (OuterVolumeSpecName: "bundle") pod "3c0c72b7-ab02-404f-ad66-a47034697f6c" (UID: "3c0c72b7-ab02-404f-ad66-a47034697f6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:42.779345 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.779321 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29" (OuterVolumeSpecName: "kube-api-access-v2c29") pod "46871f35-5ec2-4d6f-90ca-4417727da86d" (UID: "46871f35-5ec2-4d6f-90ca-4417727da86d"). InnerVolumeSpecName "kube-api-access-v2c29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:20:42.779440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.779344 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc" (OuterVolumeSpecName: "kube-api-access-8f5vc") pod "3c0c72b7-ab02-404f-ad66-a47034697f6c" (UID: "3c0c72b7-ab02-404f-ad66-a47034697f6c"). InnerVolumeSpecName "kube-api-access-8f5vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:20:42.783166 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.783127 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util" (OuterVolumeSpecName: "util") pod "3c0c72b7-ab02-404f-ad66-a47034697f6c" (UID: "3c0c72b7-ab02-404f-ad66-a47034697f6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:42.783465 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.783448 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util" (OuterVolumeSpecName: "util") pod "46871f35-5ec2-4d6f-90ca-4417727da86d" (UID: "46871f35-5ec2-4d6f-90ca-4417727da86d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:42.878211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878165 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:42.878211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878201 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:42.878211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878210 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46871f35-5ec2-4d6f-90ca-4417727da86d-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:42.878211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878218 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f5vc\" (UniqueName: \"kubernetes.io/projected/3c0c72b7-ab02-404f-ad66-a47034697f6c-kube-api-access-8f5vc\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:42.878211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878228 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0c72b7-ab02-404f-ad66-a47034697f6c-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:42.878486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:42.878237 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2c29\" (UniqueName: \"kubernetes.io/projected/46871f35-5ec2-4d6f-90ca-4417727da86d-kube-api-access-v2c29\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:43.438425 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.438399 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" Jul 10 02:20:43.438425 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.438415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92" event={"ID":"46871f35-5ec2-4d6f-90ca-4417727da86d","Type":"ContainerDied","Data":"882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996"} Jul 10 02:20:43.438876 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.438462 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="882658c03733f9fb62c6629283c95d582bd8ac78970e29072ac0058809d09996" Jul 10 02:20:43.440501 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.440474 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" Jul 10 02:20:43.440501 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.440494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m" event={"ID":"3c0c72b7-ab02-404f-ad66-a47034697f6c","Type":"ContainerDied","Data":"cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67"} Jul 10 02:20:43.440741 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.440531 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cee810740fe1f4fac31183a11b72f267024c921f65228324e6bb3d1f13a3cc67" Jul 10 02:20:43.442701 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.442678 2567 generic.go:356] "Generic (PLEG): container finished" podID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerID="422436c1b3fe8e0c43c0e225180894929dbc23612643c0371e681791adb7e037" exitCode=0 Jul 10 02:20:43.442829 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.442710 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerDied","Data":"422436c1b3fe8e0c43c0e225180894929dbc23612643c0371e681791adb7e037"} Jul 10 02:20:43.534032 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.533982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:43.580353 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.580325 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:43.685737 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.685706 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle\") pod \"093b8d59-ff26-4f71-ba04-739b6ab129d0\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " Jul 10 02:20:43.685737 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.685743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util\") pod \"093b8d59-ff26-4f71-ba04-739b6ab129d0\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " Jul 10 02:20:43.685951 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.685761 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw7nt\" (UniqueName: \"kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt\") pod \"093b8d59-ff26-4f71-ba04-739b6ab129d0\" (UID: \"093b8d59-ff26-4f71-ba04-739b6ab129d0\") " Jul 10 02:20:43.686277 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.686253 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle" (OuterVolumeSpecName: "bundle") pod "093b8d59-ff26-4f71-ba04-739b6ab129d0" (UID: "093b8d59-ff26-4f71-ba04-739b6ab129d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:43.687995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.687973 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt" (OuterVolumeSpecName: "kube-api-access-jw7nt") pod "093b8d59-ff26-4f71-ba04-739b6ab129d0" (UID: "093b8d59-ff26-4f71-ba04-739b6ab129d0"). InnerVolumeSpecName "kube-api-access-jw7nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:20:43.691210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.691151 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util" (OuterVolumeSpecName: "util") pod "093b8d59-ff26-4f71-ba04-739b6ab129d0" (UID: "093b8d59-ff26-4f71-ba04-739b6ab129d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:43.787076 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.787043 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:43.787076 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.787069 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/093b8d59-ff26-4f71-ba04-739b6ab129d0-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:43.787076 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:43.787078 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw7nt\" (UniqueName: \"kubernetes.io/projected/093b8d59-ff26-4f71-ba04-739b6ab129d0-kube-api-access-jw7nt\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:44.450418 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.450336 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" Jul 10 02:20:44.450418 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.450370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm" event={"ID":"093b8d59-ff26-4f71-ba04-739b6ab129d0","Type":"ContainerDied","Data":"37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd"} Jul 10 02:20:44.450861 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.450442 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37c627615671bf12df1a9d6eb00f53fc50f63243580797861e8a389ea52560dd" Jul 10 02:20:44.581470 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.581446 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:44.694770 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.694736 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q87c2\" (UniqueName: \"kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2\") pod \"eba78049-d65e-46aa-acb4-2617c6d16b05\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " Jul 10 02:20:44.694914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.694817 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util\") pod \"eba78049-d65e-46aa-acb4-2617c6d16b05\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " Jul 10 02:20:44.694914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.694839 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle\") pod \"eba78049-d65e-46aa-acb4-2617c6d16b05\" (UID: \"eba78049-d65e-46aa-acb4-2617c6d16b05\") " Jul 10 02:20:44.695378 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.695347 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle" (OuterVolumeSpecName: "bundle") pod "eba78049-d65e-46aa-acb4-2617c6d16b05" (UID: "eba78049-d65e-46aa-acb4-2617c6d16b05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:44.697055 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.697027 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2" (OuterVolumeSpecName: "kube-api-access-q87c2") pod "eba78049-d65e-46aa-acb4-2617c6d16b05" (UID: "eba78049-d65e-46aa-acb4-2617c6d16b05"). InnerVolumeSpecName "kube-api-access-q87c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:20:44.700506 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.700463 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util" (OuterVolumeSpecName: "util") pod "eba78049-d65e-46aa-acb4-2617c6d16b05" (UID: "eba78049-d65e-46aa-acb4-2617c6d16b05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:20:44.795928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.795882 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q87c2\" (UniqueName: \"kubernetes.io/projected/eba78049-d65e-46aa-acb4-2617c6d16b05-kube-api-access-q87c2\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:44.795928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.795926 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-util\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:44.795928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:44.795936 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eba78049-d65e-46aa-acb4-2617c6d16b05-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:20:45.457806 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:45.457774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" event={"ID":"eba78049-d65e-46aa-acb4-2617c6d16b05","Type":"ContainerDied","Data":"44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3"} Jul 10 02:20:45.457806 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:45.457805 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp" Jul 10 02:20:45.458218 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:45.457822 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44179cc84c2f316f16ed287d18c35bb2145a88f691367309c84acf03090224a3" Jul 10 02:20:52.027523 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:52.027474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:54.439928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.439888 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8"] Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440351 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="pull" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440369 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="pull" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440386 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="util" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440395 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="util" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440404 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440413 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440433 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440441 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440449 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440458 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="extract" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440468 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="util" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440476 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="util" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440484 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="pull" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440491 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="pull" Jul 10 02:20:54.440499 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440502 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="pull" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440511 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="pull" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440519 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="extract" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440527 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="extract" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440537 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="util" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440545 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="util" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440562 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="pull" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440570 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="pull" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440581 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="util" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440589 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="util" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440705 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46871f35-5ec2-4d6f-90ca-4417727da86d" containerName="extract" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440719 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="093b8d59-ff26-4f71-ba04-739b6ab129d0" containerName="extract" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440731 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0c72b7-ab02-404f-ad66-a47034697f6c" containerName="extract" Jul 10 02:20:54.441366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.440739 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba78049-d65e-46aa-acb4-2617c6d16b05" containerName="extract" Jul 10 02:20:54.444087 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.444068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:54.446767 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.446745 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pbksm\"" Jul 10 02:20:54.453439 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.453419 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8"] Jul 10 02:20:54.465380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.465357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s45\" (UniqueName: \"kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45\") pod \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" (UID: \"9a67c78e-56a3-44df-bc60-dd17389267c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:54.566537 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.566503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s45\" (UniqueName: \"kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45\") pod \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" (UID: \"9a67c78e-56a3-44df-bc60-dd17389267c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:54.580866 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.580827 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s45\" (UniqueName: \"kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45\") pod \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" (UID: \"9a67c78e-56a3-44df-bc60-dd17389267c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:54.754609 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.754575 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:54.892089 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:54.892065 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8"] Jul 10 02:20:54.893902 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:20:54.893859 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a67c78e_56a3_44df_bc60_dd17389267c4.slice/crio-6188e3decc0376e0adf1de7b98e1cab07f53216d1815f6a0b5b355c60e341d7d WatchSource:0}: Error finding container 6188e3decc0376e0adf1de7b98e1cab07f53216d1815f6a0b5b355c60e341d7d: Status 404 returned error can't find the container with id 6188e3decc0376e0adf1de7b98e1cab07f53216d1815f6a0b5b355c60e341d7d Jul 10 02:20:55.438522 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:55.438486 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:55.508108 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:55.508073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" event={"ID":"9a67c78e-56a3-44df-bc60-dd17389267c4","Type":"ContainerStarted","Data":"6188e3decc0376e0adf1de7b98e1cab07f53216d1815f6a0b5b355c60e341d7d"} Jul 10 02:20:55.557346 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:55.557309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:20:57.519947 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:57.519899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" event={"ID":"9a67c78e-56a3-44df-bc60-dd17389267c4","Type":"ContainerStarted","Data":"42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1"} Jul 10 02:20:57.520327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:57.520053 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:20:57.536618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:57.536572 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" podStartSLOduration=1.327515421 podStartE2EDuration="3.536558656s" totalImagesPullingTime="2.209043235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:20:57.535524769 +0000 UTC m=+416.595929820" watchObservedRunningTime="2026-07-10 02:20:57.536558656 +0000 UTC m=+416.596963681" Jul 10 02:20:59.626893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.626857 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn"] Jul 10 02:20:59.635178 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.635150 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.638240 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.638214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f5mnk\"" Jul 10 02:20:59.646755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.646729 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn"] Jul 10 02:20:59.700579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.700545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqqxl\" (UniqueName: \"kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.700742 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.700604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.801724 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.801686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqqxl\" (UniqueName: \"kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.801890 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.801766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.802186 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.802166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.810454 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.810430 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqqxl\" (UniqueName: \"kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:20:59.946068 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:20:59.945984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:00.023314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:00.023278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:00.094532 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:00.094511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn"] Jul 10 02:21:00.096583 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:00.096555 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eacca22_ba9b_4f0a_bd7b_f34a8456b141.slice/crio-ad4d036af69f1cd95b4454697371dad023100a7f43dd1ff216d3926a0a480162 WatchSource:0}: Error finding container ad4d036af69f1cd95b4454697371dad023100a7f43dd1ff216d3926a0a480162: Status 404 returned error can't find the container with id ad4d036af69f1cd95b4454697371dad023100a7f43dd1ff216d3926a0a480162 Jul 10 02:21:00.431016 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:00.430976 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:00.535898 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:00.535862 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" event={"ID":"0eacca22-ba9b-4f0a-bd7b-f34a8456b141","Type":"ContainerStarted","Data":"ad4d036af69f1cd95b4454697371dad023100a7f43dd1ff216d3926a0a480162"} Jul 10 02:21:01.838210 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:01.838170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:02.166396 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.166280 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w"] Jul 10 02:21:02.171933 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.171894 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:02.174407 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.174383 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kxk9c\"" Jul 10 02:21:02.181773 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.181748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w"] Jul 10 02:21:02.221775 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.221741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jwq\" (UniqueName: \"kubernetes.io/projected/219226ca-59da-4451-aae5-b193c665f09e-kube-api-access-82jwq\") pod \"authorino-operator-75cc8d5cb7-nfx5w\" (UID: \"219226ca-59da-4451-aae5-b193c665f09e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:02.322216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.322184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jwq\" (UniqueName: \"kubernetes.io/projected/219226ca-59da-4451-aae5-b193c665f09e-kube-api-access-82jwq\") pod \"authorino-operator-75cc8d5cb7-nfx5w\" (UID: \"219226ca-59da-4451-aae5-b193c665f09e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:02.331162 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.331130 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jwq\" (UniqueName: \"kubernetes.io/projected/219226ca-59da-4451-aae5-b193c665f09e-kube-api-access-82jwq\") pod \"authorino-operator-75cc8d5cb7-nfx5w\" (UID: \"219226ca-59da-4451-aae5-b193c665f09e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:02.485693 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.485584 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:02.626256 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:02.626222 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w"] Jul 10 02:21:02.627905 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:02.627879 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219226ca_59da_4451_aae5_b193c665f09e.slice/crio-dff6194efc372ce0dc84955c1697d80f17ed288170ca85a910124a4360532613 WatchSource:0}: Error finding container dff6194efc372ce0dc84955c1697d80f17ed288170ca85a910124a4360532613: Status 404 returned error can't find the container with id dff6194efc372ce0dc84955c1697d80f17ed288170ca85a910124a4360532613 Jul 10 02:21:03.409119 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:03.409082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:03.556923 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:03.556886 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" event={"ID":"219226ca-59da-4451-aae5-b193c665f09e","Type":"ContainerStarted","Data":"dff6194efc372ce0dc84955c1697d80f17ed288170ca85a910124a4360532613"} Jul 10 02:21:04.220539 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:04.220490 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:04.320355 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:04.320318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:05.572140 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.572102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" event={"ID":"219226ca-59da-4451-aae5-b193c665f09e","Type":"ContainerStarted","Data":"6da9874fcfaea329d5d9bec41d0c1ed341dcb450ad9ed85b97f4ec5858fc1d59"} Jul 10 02:21:05.572566 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.572193 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:05.576057 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.576035 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj"] Jul 10 02:21:05.579569 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.579552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:05.581694 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.581674 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 10 02:21:05.581794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.581674 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-skxrn\"" Jul 10 02:21:05.594277 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.594225 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" podStartSLOduration=1.062023121 podStartE2EDuration="3.594205704s" totalImagesPullingTime="2.532182583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:05.588874043 +0000 UTC m=+424.649279088" watchObservedRunningTime="2026-07-10 02:21:05.594205704 +0000 UTC m=+424.654610731" Jul 10 02:21:05.594616 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.593929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj"] Jul 10 02:21:05.651637 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.651604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wgm\" (UniqueName: \"kubernetes.io/projected/97d83d58-9bd3-4bbc-8365-b904e16e1074-kube-api-access-55wgm\") pod \"dns-operator-controller-manager-864dd78c4c-7dgzj\" (UID: \"97d83d58-9bd3-4bbc-8365-b904e16e1074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:05.753031 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.752993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wgm\" (UniqueName: \"kubernetes.io/projected/97d83d58-9bd3-4bbc-8365-b904e16e1074-kube-api-access-55wgm\") pod \"dns-operator-controller-manager-864dd78c4c-7dgzj\" (UID: \"97d83d58-9bd3-4bbc-8365-b904e16e1074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:05.763421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.763394 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wgm\" (UniqueName: \"kubernetes.io/projected/97d83d58-9bd3-4bbc-8365-b904e16e1074-kube-api-access-55wgm\") pod \"dns-operator-controller-manager-864dd78c4c-7dgzj\" (UID: \"97d83d58-9bd3-4bbc-8365-b904e16e1074\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:05.898437 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:05.898357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:06.044974 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:06.044946 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj"] Jul 10 02:21:06.046762 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:06.046727 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d83d58_9bd3_4bbc_8365_b904e16e1074.slice/crio-d9934248e76ca6f1857eb19a1fba294a74194cc0298efeb27aa197fbb1fb4679 WatchSource:0}: Error finding container d9934248e76ca6f1857eb19a1fba294a74194cc0298efeb27aa197fbb1fb4679: Status 404 returned error can't find the container with id d9934248e76ca6f1857eb19a1fba294a74194cc0298efeb27aa197fbb1fb4679 Jul 10 02:21:06.221004 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:06.220918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:06.580884 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:06.580829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" event={"ID":"97d83d58-9bd3-4bbc-8365-b904e16e1074","Type":"ContainerStarted","Data":"d9934248e76ca6f1857eb19a1fba294a74194cc0298efeb27aa197fbb1fb4679"} Jul 10 02:21:07.080184 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.080153 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85cb76845-2qp9n"] Jul 10 02:21:07.084423 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.084393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.098162 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.098133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cb76845-2qp9n"] Jul 10 02:21:07.141570 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.141509 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:07.167494 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-service-ca\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167494 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-trusted-ca-bundle\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-oauth-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-oauth-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngnbm\" (UniqueName: \"kubernetes.io/projected/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-kube-api-access-ngnbm\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.167929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.167767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngnbm\" (UniqueName: \"kubernetes.io/projected/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-kube-api-access-ngnbm\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-service-ca\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269489 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-trusted-ca-bundle\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269489 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-oauth-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-oauth-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.269964 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269939 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-service-ca\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.270080 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.269996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.270267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.270238 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-oauth-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.270267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.270253 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-trusted-ca-bundle\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.272782 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.272761 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-oauth-config\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.272881 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.272796 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-console-serving-cert\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.277280 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.277260 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngnbm\" (UniqueName: \"kubernetes.io/projected/53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e-kube-api-access-ngnbm\") pod \"console-85cb76845-2qp9n\" (UID: \"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e\") " pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.399603 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.399530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:07.589156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.589096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:07.652120 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.652097 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85cb76845-2qp9n"] Jul 10 02:21:07.654185 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:07.654160 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ac8f6a_d2ef_42c4_be6c_3abc2d2a801e.slice/crio-18ccef76f6b0fd9d006ccdc473a7232d0250e3f95348b016660b73939e140b23 WatchSource:0}: Error finding container 18ccef76f6b0fd9d006ccdc473a7232d0250e3f95348b016660b73939e140b23: Status 404 returned error can't find the container with id 18ccef76f6b0fd9d006ccdc473a7232d0250e3f95348b016660b73939e140b23 Jul 10 02:21:07.656984 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:07.656937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:08.527544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.527512 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:08.596596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.596554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" event={"ID":"0eacca22-ba9b-4f0a-bd7b-f34a8456b141","Type":"ContainerStarted","Data":"8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9"} Jul 10 02:21:08.597035 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.596733 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:08.598713 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.598689 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cb76845-2qp9n" event={"ID":"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e","Type":"ContainerStarted","Data":"1835c249d5d32eb6d199ddcbf24bc6d2d6d6c1cd4ddef5e3509878f1f89dfcc2"} Jul 10 02:21:08.598833 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.598730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85cb76845-2qp9n" event={"ID":"53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e","Type":"ContainerStarted","Data":"18ccef76f6b0fd9d006ccdc473a7232d0250e3f95348b016660b73939e140b23"} Jul 10 02:21:08.622996 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.622944 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" podStartSLOduration=2.15092382 podStartE2EDuration="9.622924226s" totalImagesPullingTime="7.472000406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:08.619595074 +0000 UTC m=+427.680000124" watchObservedRunningTime="2026-07-10 02:21:08.622924226 +0000 UTC m=+427.683329252" Jul 10 02:21:08.641796 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:08.641743 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85cb76845-2qp9n" podStartSLOduration=1.641729877 podStartE2EDuration="1.641729877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:08.639642787 +0000 UTC m=+427.700047834" watchObservedRunningTime="2026-07-10 02:21:08.641729877 +0000 UTC m=+427.702134901" Jul 10 02:21:09.606967 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:09.606916 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" event={"ID":"97d83d58-9bd3-4bbc-8365-b904e16e1074","Type":"ContainerStarted","Data":"1611fc41cb3c0d448935c22f2f5d6ab731b5d13b549d9821b7beda7eac973555"} Jul 10 02:21:09.607423 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:09.607029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:09.636460 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:09.636407 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" podStartSLOduration=1.722395712 podStartE2EDuration="4.636393113s" totalImagesPullingTime="2.913997401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:09.635548345 +0000 UTC m=+428.695953382" watchObservedRunningTime="2026-07-10 02:21:09.636393113 +0000 UTC m=+428.696798183" Jul 10 02:21:10.456123 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.456089 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n"] Jul 10 02:21:10.459597 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.459576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.462098 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.462070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 10 02:21:10.462205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.462160 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 10 02:21:10.462205 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.462173 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7ttbp\"" Jul 10 02:21:10.470124 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.470095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:10.471695 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.471672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n"] Jul 10 02:21:10.500376 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.500351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.500483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.500379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c1d1f20-cbed-4049-bed3-5191ce190fce-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.500483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.500400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zs5r\" (UniqueName: \"kubernetes.io/projected/6c1d1f20-cbed-4049-bed3-5191ce190fce-kube-api-access-6zs5r\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.601484 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.601461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.601484 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.601491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c1d1f20-cbed-4049-bed3-5191ce190fce-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.601639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.601513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs5r\" (UniqueName: \"kubernetes.io/projected/6c1d1f20-cbed-4049-bed3-5191ce190fce-kube-api-access-6zs5r\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.601639 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:10.601558 2567 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 10 02:21:10.601742 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:10.601678 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert podName:6c1d1f20-cbed-4049-bed3-5191ce190fce nodeName:}" failed. No retries permitted until 2026-07-10 02:21:11.101629318 +0000 UTC m=+430.162034324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-jt26n" (UID: "6c1d1f20-cbed-4049-bed3-5191ce190fce") : secret "plugin-serving-cert" not found Jul 10 02:21:10.602133 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.602116 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c1d1f20-cbed-4049-bed3-5191ce190fce-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.611339 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.611318 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zs5r\" (UniqueName: \"kubernetes.io/projected/6c1d1f20-cbed-4049-bed3-5191ce190fce-kube-api-access-6zs5r\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:10.809476 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.809444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:10.999997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:10.999965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:11.100324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.100224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:11.106314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.106292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:11.108910 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.108891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d1f20-cbed-4049-bed3-5191ce190fce-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jt26n\" (UID: \"6c1d1f20-cbed-4049-bed3-5191ce190fce\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:11.369081 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.368993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" Jul 10 02:21:11.512630 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.512606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n"] Jul 10 02:21:11.514295 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:11.514265 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c1d1f20_cbed_4049_bed3_5191ce190fce.slice/crio-39a4f5949eb9501daf3b516ed6df658b51d2d06545f2e201edbf16c39f6a8745 WatchSource:0}: Error finding container 39a4f5949eb9501daf3b516ed6df658b51d2d06545f2e201edbf16c39f6a8745: Status 404 returned error can't find the container with id 39a4f5949eb9501daf3b516ed6df658b51d2d06545f2e201edbf16c39f6a8745 Jul 10 02:21:11.619882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:11.619794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" event={"ID":"6c1d1f20-cbed-4049-bed3-5191ce190fce","Type":"ContainerStarted","Data":"39a4f5949eb9501daf3b516ed6df658b51d2d06545f2e201edbf16c39f6a8745"} Jul 10 02:21:16.583698 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:16.583627 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nfx5w" Jul 10 02:21:17.399941 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.399904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:17.400116 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.399966 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:17.405997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.405972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:17.663567 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.663478 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85cb76845-2qp9n" Jul 10 02:21:17.712330 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.712296 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:21:17.837399 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.837362 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:17.939115 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:17.939018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:18.039687 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:18.039618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:19.609540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:19.609508 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:19.621142 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:19.621109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:19.719631 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:19.719543 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:20.616011 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:20.615981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7dgzj" Jul 10 02:21:21.032192 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.032154 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7"] Jul 10 02:21:21.035808 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.035785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.050956 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.050929 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7"] Jul 10 02:21:21.096336 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.096301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.096523 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.096449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njt7t\" (UniqueName: \"kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.150858 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.150824 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7"] Jul 10 02:21:21.151194 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.151169 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-njt7t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" Jul 10 02:21:21.196884 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.196854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njt7t\" (UniqueName: \"kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.197053 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.196892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.197275 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.197256 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.227218 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.227194 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njt7t\" (UniqueName: \"kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.595206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.595163 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7"] Jul 10 02:21:21.611277 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.611248 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7"] Jul 10 02:21:21.621787 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.621753 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn"] Jul 10 02:21:21.622173 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.622007 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" containerName="manager" containerID="cri-o://8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9" gracePeriod=2 Jul 10 02:21:21.635669 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.635600 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn"] Jul 10 02:21:21.646489 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.646402 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\": pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:21.655249 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.655188 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:21.658179 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.656864 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" containerName="manager" Jul 10 02:21:21.658179 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.656892 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" containerName="manager" Jul 10 02:21:21.658179 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.657069 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" containerName="manager" Jul 10 02:21:21.661437 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.661391 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8"] Jul 10 02:21:21.661928 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.661895 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.662906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.662171 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" containerName="manager" containerID="cri-o://42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1" gracePeriod=2 Jul 10 02:21:21.665219 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.664833 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:21.667213 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.667192 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8"] Jul 10 02:21:21.668280 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.668247 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:21.672912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.672855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:21.675343 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.675318 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88"] Jul 10 02:21:21.675897 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.675877 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" containerName="manager" Jul 10 02:21:21.675994 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.675900 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" containerName="manager" Jul 10 02:21:21.676057 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.675994 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" containerName="manager" Jul 10 02:21:21.679246 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.679226 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:21.691992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.691966 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88"] Jul 10 02:21:21.692907 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.692882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.702125 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.702083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.702250 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.702158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsb44\" (UniqueName: \"kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.708878 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.708842 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:21.710838 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.710806 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:21.712718 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.712689 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:21.714602 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.714577 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:21.716466 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.716437 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.775421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.775388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.777850 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.777818 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:21.779675 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.779610 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:21.781465 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:21.781428 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:21.803120 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.803071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.803294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.803168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6fh4\" (UniqueName: \"kubernetes.io/projected/4887e8af-b27a-45c9-bd0f-1d5f476c0f3b-kube-api-access-j6fh4\") pod \"limitador-operator-controller-manager-859d7b78bd-pbk88\" (UID: \"4887e8af-b27a-45c9-bd0f-1d5f476c0f3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:21.803294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.803205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsb44\" (UniqueName: \"kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.803527 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.803494 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.814340 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.814310 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsb44\" (UniqueName: \"kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x4mzn\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:21.904788 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.904702 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume\") pod \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " Jul 10 02:21:21.904788 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.904745 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njt7t\" (UniqueName: \"kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t\") pod \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\" (UID: \"5c18ef11-dacc-4a5b-b311-40a2127f31bb\") " Jul 10 02:21:21.905026 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.904934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6fh4\" (UniqueName: \"kubernetes.io/projected/4887e8af-b27a-45c9-bd0f-1d5f476c0f3b-kube-api-access-j6fh4\") pod \"limitador-operator-controller-manager-859d7b78bd-pbk88\" (UID: \"4887e8af-b27a-45c9-bd0f-1d5f476c0f3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:21.905026 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.904992 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c18ef11-dacc-4a5b-b311-40a2127f31bb" (UID: "5c18ef11-dacc-4a5b-b311-40a2127f31bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:21:21.907602 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.907569 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t" (OuterVolumeSpecName: "kube-api-access-njt7t") pod "5c18ef11-dacc-4a5b-b311-40a2127f31bb" (UID: "5c18ef11-dacc-4a5b-b311-40a2127f31bb"). InnerVolumeSpecName "kube-api-access-njt7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:21:21.915258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:21.915231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6fh4\" (UniqueName: \"kubernetes.io/projected/4887e8af-b27a-45c9-bd0f-1d5f476c0f3b-kube-api-access-j6fh4\") pod \"limitador-operator-controller-manager-859d7b78bd-pbk88\" (UID: \"4887e8af-b27a-45c9-bd0f-1d5f476c0f3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:22.005525 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.005492 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c18ef11-dacc-4a5b-b311-40a2127f31bb-extensions-socket-volume\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:22.005525 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.005519 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njt7t\" (UniqueName: \"kubernetes.io/projected/5c18ef11-dacc-4a5b-b311-40a2127f31bb-kube-api-access-njt7t\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:22.062224 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.062183 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:22.071717 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.071691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:22.089952 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.089905 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:22.181446 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.181360 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:22.699805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:22.699707 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:22.702121 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.702091 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:22.704234 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.704194 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:22.706634 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.706605 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:22.710714 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.710685 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:22.715012 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.714980 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:22.720542 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:22.720506 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-q5kb7\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-q5kb7" Jul 10 02:21:23.475142 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:23.475108 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c18ef11-dacc-4a5b-b311-40a2127f31bb" path="/var/lib/kubelet/pods/5c18ef11-dacc-4a5b-b311-40a2127f31bb/volumes" Jul 10 02:21:26.325056 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:26.325019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:26.425416 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:26.425375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:28.807900 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:28.807859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:28.905284 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:28.905245 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:35.657332 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.657303 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.659746 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.659719 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.660055 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.660040 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.661861 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.661837 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.663439 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.663420 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.739267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.739183 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqqxl\" (UniqueName: \"kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl\") pod \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " Jul 10 02:21:35.739409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.739270 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9s45\" (UniqueName: \"kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45\") pod \"9a67c78e-56a3-44df-bc60-dd17389267c4\" (UID: \"9a67c78e-56a3-44df-bc60-dd17389267c4\") " Jul 10 02:21:35.739409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.739311 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume\") pod \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\" (UID: \"0eacca22-ba9b-4f0a-bd7b-f34a8456b141\") " Jul 10 02:21:35.739838 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.739802 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0eacca22-ba9b-4f0a-bd7b-f34a8456b141" (UID: "0eacca22-ba9b-4f0a-bd7b-f34a8456b141"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:21:35.741247 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.741219 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl" (OuterVolumeSpecName: "kube-api-access-wqqxl") pod "0eacca22-ba9b-4f0a-bd7b-f34a8456b141" (UID: "0eacca22-ba9b-4f0a-bd7b-f34a8456b141"). InnerVolumeSpecName "kube-api-access-wqqxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:21:35.741331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.741292 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45" (OuterVolumeSpecName: "kube-api-access-n9s45") pod "9a67c78e-56a3-44df-bc60-dd17389267c4" (UID: "9a67c78e-56a3-44df-bc60-dd17389267c4"). InnerVolumeSpecName "kube-api-access-n9s45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:21:35.782689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.782631 2567 generic.go:356] "Generic (PLEG): container finished" podID="9a67c78e-56a3-44df-bc60-dd17389267c4" containerID="42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1" exitCode=0 Jul 10 02:21:35.782793 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.782698 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.782793 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.782731 2567 scope.go:117] "RemoveContainer" containerID="42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1" Jul 10 02:21:35.784503 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.784463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" event={"ID":"6c1d1f20-cbed-4049-bed3-5191ce190fce","Type":"ContainerStarted","Data":"9d544cbde94cf5cc771f26c16b0bcc6de3ed3e20e8dffd2f99aa015618671fbd"} Jul 10 02:21:35.784963 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.784941 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.786163 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.786142 2567 generic.go:356] "Generic (PLEG): container finished" podID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" containerID="8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9" exitCode=0 Jul 10 02:21:35.786259 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.786175 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.786739 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.786713 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.788703 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.788676 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.790524 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.790488 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.792876 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.792858 2567 scope.go:117] "RemoveContainer" containerID="42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1" Jul 10 02:21:35.793171 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.793135 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1\": container with ID starting with 42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1 not found: ID does not exist" containerID="42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1" Jul 10 02:21:35.793252 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.793177 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1"} err="failed to get container status \"42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1\": rpc error: code = NotFound desc = could not find container \"42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1\": container with ID starting with 42f802b8413a62570d9d8d9824c05992a77ab6a3d8009d14b51a5751fccff3b1 not found: ID does not exist" Jul 10 02:21:35.793252 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.793196 2567 scope.go:117] "RemoveContainer" containerID="8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9" Jul 10 02:21:35.801286 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.801269 2567 scope.go:117] "RemoveContainer" containerID="8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9" Jul 10 02:21:35.801532 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.801511 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9\": container with ID starting with 8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9 not found: ID does not exist" containerID="8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9" Jul 10 02:21:35.801579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.801544 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9"} err="failed to get container status \"8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9\": rpc error: code = NotFound desc = could not find container \"8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9\": container with ID starting with 8eec6ac1ab4f73e3aef2dba97142ec8d9371d0fb84d76639d12407311944c5f9 not found: ID does not exist" Jul 10 02:21:35.806565 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.806530 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jt26n" podStartSLOduration=1.725894794 podStartE2EDuration="25.806519632s" totalImagesPullingTime="24.080624838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:35.80553498 +0000 UTC m=+454.865940003" watchObservedRunningTime="2026-07-10 02:21:35.806519632 +0000 UTC m=+454.866924656" Jul 10 02:21:35.807493 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.807472 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:35.809214 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:35.809194 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:35.840947 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.840906 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqqxl\" (UniqueName: \"kubernetes.io/projected/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-kube-api-access-wqqxl\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:35.841105 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.840958 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9s45\" (UniqueName: \"kubernetes.io/projected/9a67c78e-56a3-44df-bc60-dd17389267c4-kube-api-access-n9s45\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:35.841105 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.840974 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0eacca22-ba9b-4f0a-bd7b-f34a8456b141-extensions-socket-volume\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:35.867761 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.867701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88"] Jul 10 02:21:35.870002 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:35.869895 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4887e8af_b27a_45c9_bd0f_1d5f476c0f3b.slice/crio-da6adee4c0255fa5cd16e41d5fd38f6921939459c5f56e19c254720b0af56a9b WatchSource:0}: Error finding container da6adee4c0255fa5cd16e41d5fd38f6921939459c5f56e19c254720b0af56a9b: Status 404 returned error can't find the container with id da6adee4c0255fa5cd16e41d5fd38f6921939459c5f56e19c254720b0af56a9b Jul 10 02:21:35.870194 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:35.870174 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:35.872403 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:35.872384 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9783cc58_3380_4f0c_9ff8_abbdf2ee8599.slice/crio-f236949228fab3e27c4cc2366813536139995e6a181fbc1b8cd9894fe5f4fd87 WatchSource:0}: Error finding container f236949228fab3e27c4cc2366813536139995e6a181fbc1b8cd9894fe5f4fd87: Status 404 returned error can't find the container with id f236949228fab3e27c4cc2366813536139995e6a181fbc1b8cd9894fe5f4fd87 Jul 10 02:21:36.793687 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.793625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" event={"ID":"9783cc58-3380-4f0c-9ff8-abbdf2ee8599","Type":"ContainerStarted","Data":"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780"} Jul 10 02:21:36.794164 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.793716 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:36.794164 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.793738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" event={"ID":"9783cc58-3380-4f0c-9ff8-abbdf2ee8599","Type":"ContainerStarted","Data":"f236949228fab3e27c4cc2366813536139995e6a181fbc1b8cd9894fe5f4fd87"} Jul 10 02:21:36.796226 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.796201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" event={"ID":"4887e8af-b27a-45c9-bd0f-1d5f476c0f3b","Type":"ContainerStarted","Data":"2843f705f0beec39659641624c7885549ac34b145787731c28a5fe5301caa043"} Jul 10 02:21:36.796430 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.796239 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" event={"ID":"4887e8af-b27a-45c9-bd0f-1d5f476c0f3b","Type":"ContainerStarted","Data":"da6adee4c0255fa5cd16e41d5fd38f6921939459c5f56e19c254720b0af56a9b"} Jul 10 02:21:36.796430 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.796282 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:36.812828 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.812777 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" podStartSLOduration=15.812759579 podStartE2EDuration="15.812759579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:36.811465981 +0000 UTC m=+455.871871027" watchObservedRunningTime="2026-07-10 02:21:36.812759579 +0000 UTC m=+455.873164603" Jul 10 02:21:36.813360 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:36.813324 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:36.815284 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:36.815257 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:36.833870 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:36.833828 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-ncvxn\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncvxn" Jul 10 02:21:36.834259 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:36.834220 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" podStartSLOduration=15.834206061 podStartE2EDuration="15.834206061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:36.831856946 +0000 UTC m=+455.892261970" watchObservedRunningTime="2026-07-10 02:21:36.834206061 +0000 UTC m=+455.894611085" Jul 10 02:21:36.835511 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:36.835486 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rzqs8\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rzqs8" Jul 10 02:21:37.473861 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:37.473826 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eacca22-ba9b-4f0a-bd7b-f34a8456b141" path="/var/lib/kubelet/pods/0eacca22-ba9b-4f0a-bd7b-f34a8456b141/volumes" Jul 10 02:21:37.474229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:37.474209 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a67c78e-56a3-44df-bc60-dd17389267c4" path="/var/lib/kubelet/pods/9a67c78e-56a3-44df-bc60-dd17389267c4/volumes" Jul 10 02:21:38.108032 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.107984 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:38.166467 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.166439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:38.391942 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.391859 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:38.735827 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.735742 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:21:38.737751 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.737713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:38.740536 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.740514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.752531 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.752506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:21:38.807544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.807504 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" podUID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" containerName="manager" containerID="cri-o://0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780" gracePeriod=10 Jul 10 02:21:38.833983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.833955 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:38.870241 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.870209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.870372 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.870249 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77lm6\" (UniqueName: \"kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.971401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.971363 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.971563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.971411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77lm6\" (UniqueName: \"kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.972112 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.971814 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:38.980013 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:38.979989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77lm6\" (UniqueName: \"kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6\") pod \"kuadrant-operator-controller-manager-86878c769f-2v6wk\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:39.052114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.052090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:39.056811 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.056794 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:39.173828 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.173803 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume\") pod \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " Jul 10 02:21:39.174275 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.173856 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsb44\" (UniqueName: \"kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44\") pod \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\" (UID: \"9783cc58-3380-4f0c-9ff8-abbdf2ee8599\") " Jul 10 02:21:39.174275 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.174216 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9783cc58-3380-4f0c-9ff8-abbdf2ee8599" (UID: "9783cc58-3380-4f0c-9ff8-abbdf2ee8599"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:21:39.176159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.176134 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44" (OuterVolumeSpecName: "kube-api-access-qsb44") pod "9783cc58-3380-4f0c-9ff8-abbdf2ee8599" (UID: "9783cc58-3380-4f0c-9ff8-abbdf2ee8599"). InnerVolumeSpecName "kube-api-access-qsb44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:21:39.200566 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.200542 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:21:39.202326 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:21:39.202299 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a0f9ce_0717_4882_a496_f42d5bf5cce1.slice/crio-e6949a047ff2e7650e9b2d9b56b48e8697584715a7d76bc08bc293912e9cc9b6 WatchSource:0}: Error finding container e6949a047ff2e7650e9b2d9b56b48e8697584715a7d76bc08bc293912e9cc9b6: Status 404 returned error can't find the container with id e6949a047ff2e7650e9b2d9b56b48e8697584715a7d76bc08bc293912e9cc9b6 Jul 10 02:21:39.275313 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.275288 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-extensions-socket-volume\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:39.275313 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.275311 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsb44\" (UniqueName: \"kubernetes.io/projected/9783cc58-3380-4f0c-9ff8-abbdf2ee8599-kube-api-access-qsb44\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:39.814901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.814866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" event={"ID":"b5a0f9ce-0717-4882-a496-f42d5bf5cce1","Type":"ContainerStarted","Data":"6835d221b524de08f555e0514cc6bdea69fc3a843c3b83ba70583bc016b7b267"} Jul 10 02:21:39.815077 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.814926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" event={"ID":"b5a0f9ce-0717-4882-a496-f42d5bf5cce1","Type":"ContainerStarted","Data":"e6949a047ff2e7650e9b2d9b56b48e8697584715a7d76bc08bc293912e9cc9b6"} Jul 10 02:21:39.815077 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.814958 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:39.816236 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.816210 2567 generic.go:356] "Generic (PLEG): container finished" podID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" containerID="0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780" exitCode=0 Jul 10 02:21:39.816379 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.816247 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" Jul 10 02:21:39.816379 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.816256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" event={"ID":"9783cc58-3380-4f0c-9ff8-abbdf2ee8599","Type":"ContainerDied","Data":"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780"} Jul 10 02:21:39.816379 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.816304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn" event={"ID":"9783cc58-3380-4f0c-9ff8-abbdf2ee8599","Type":"ContainerDied","Data":"f236949228fab3e27c4cc2366813536139995e6a181fbc1b8cd9894fe5f4fd87"} Jul 10 02:21:39.816379 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.816334 2567 scope.go:117] "RemoveContainer" containerID="0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780" Jul 10 02:21:39.831873 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.831841 2567 scope.go:117] "RemoveContainer" containerID="0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780" Jul 10 02:21:39.832145 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:39.832126 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780\": container with ID starting with 0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780 not found: ID does not exist" containerID="0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780" Jul 10 02:21:39.832220 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.832158 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780"} err="failed to get container status \"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780\": rpc error: code = NotFound desc = could not find container \"0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780\": container with ID starting with 0fcf3a8b6b0d25bb08124a7a632f72f0da020ec8f66a6d7c7c171f1611fd8780 not found: ID does not exist" Jul 10 02:21:39.835039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.835000 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" podStartSLOduration=1.834983949 podStartE2EDuration="1.834983949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:21:39.8335611 +0000 UTC m=+458.893966122" watchObservedRunningTime="2026-07-10 02:21:39.834983949 +0000 UTC m=+458.895388975" Jul 10 02:21:39.848827 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.848805 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:39.854738 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:39.854718 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x4mzn"] Jul 10 02:21:41.478879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:41.478842 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" path="/var/lib/kubelet/pods/9783cc58-3380-4f0c-9ff8-abbdf2ee8599/volumes" Jul 10 02:21:42.740229 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:42.740191 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c4fd8dfc-29nqj" podUID="c48d2161-f638-4248-864b-a60d96c034d6" containerName="console" containerID="cri-o://f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b" gracePeriod=15 Jul 10 02:21:42.995380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:42.995321 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:21:43.107150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107112 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107147 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107172 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107193 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107214 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107240 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lc66\" (UniqueName: \"kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107269 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert\") pod \"c48d2161-f638-4248-864b-a60d96c034d6\" (UID: \"c48d2161-f638-4248-864b-a60d96c034d6\") " Jul 10 02:21:43.107768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107735 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:21:43.107894 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107768 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config" (OuterVolumeSpecName: "console-config") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:21:43.107894 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107867 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:21:43.108182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.107893 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:21:43.109695 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.109668 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:21:43.109805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.109729 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:21:43.109805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.109766 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66" (OuterVolumeSpecName: "kube-api-access-2lc66") pod "c48d2161-f638-4248-864b-a60d96c034d6" (UID: "c48d2161-f638-4248-864b-a60d96c034d6"). InnerVolumeSpecName "kube-api-access-2lc66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:21:43.208413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208377 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208405 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-trusted-ca-bundle\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208415 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-service-ca\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208686 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208424 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-oauth-serving-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208686 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208434 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48d2161-f638-4248-864b-a60d96c034d6-console-oauth-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208686 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208442 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48d2161-f638-4248-864b-a60d96c034d6-console-config\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.208686 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.208450 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lc66\" (UniqueName: \"kubernetes.io/projected/c48d2161-f638-4248-864b-a60d96c034d6-kube-api-access-2lc66\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:21:43.714726 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.714687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:43.813573 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.813537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:43.841543 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.841512 2567 generic.go:356] "Generic (PLEG): container finished" podID="c48d2161-f638-4248-864b-a60d96c034d6" containerID="f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b" exitCode=0 Jul 10 02:21:43.841755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.841567 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fd8dfc-29nqj" Jul 10 02:21:43.841755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.841594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fd8dfc-29nqj" event={"ID":"c48d2161-f638-4248-864b-a60d96c034d6","Type":"ContainerDied","Data":"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b"} Jul 10 02:21:43.841755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.841672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fd8dfc-29nqj" event={"ID":"c48d2161-f638-4248-864b-a60d96c034d6","Type":"ContainerDied","Data":"e193fc1a474a544e8d3b37572bad2676624daefd49babf6e3d3c98f8e3612f60"} Jul 10 02:21:43.841755 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.841688 2567 scope.go:117] "RemoveContainer" containerID="f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b" Jul 10 02:21:43.850938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.850918 2567 scope.go:117] "RemoveContainer" containerID="f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b" Jul 10 02:21:43.851225 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:21:43.851206 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b\": container with ID starting with f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b not found: ID does not exist" containerID="f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b" Jul 10 02:21:43.851276 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.851237 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b"} err="failed to get container status \"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b\": rpc error: code = NotFound desc = could not find container \"f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b\": container with ID starting with f9168ffcf83e11dd5f216d6a1647697243444ece40b312910138157e6deb8b7b not found: ID does not exist" Jul 10 02:21:43.860062 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.860040 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:21:43.866335 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:43.866313 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c4fd8dfc-29nqj"] Jul 10 02:21:45.475154 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:45.475113 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c48d2161-f638-4248-864b-a60d96c034d6" path="/var/lib/kubelet/pods/c48d2161-f638-4248-864b-a60d96c034d6/volumes" Jul 10 02:21:47.804059 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:47.804025 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pbk88" Jul 10 02:21:48.364519 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:48.364479 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:48.464838 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:48.464789 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:50.826406 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:50.826381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:21:52.156963 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:52.156923 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:52.260613 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:52.260576 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:54.909780 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:54.909742 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:21:55.098812 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:21:55.098777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:02.120126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:02.120082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:02.220845 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:02.220804 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:04.567846 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:04.567810 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:04.671188 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:04.671151 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:06.922506 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:06.922446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:08.561153 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.561113 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:08.568349 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568324 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:08.568847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568819 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48d2161-f638-4248-864b-a60d96c034d6" containerName="console" Jul 10 02:22:08.568847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568840 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48d2161-f638-4248-864b-a60d96c034d6" containerName="console" Jul 10 02:22:08.569012 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568877 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" containerName="manager" Jul 10 02:22:08.569012 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568883 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" containerName="manager" Jul 10 02:22:08.569012 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568960 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48d2161-f638-4248-864b-a60d96c034d6" containerName="console" Jul 10 02:22:08.569012 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.568974 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9783cc58-3380-4f0c-9ff8-abbdf2ee8599" containerName="manager" Jul 10 02:22:08.590430 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.590408 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:08.590548 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.590499 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.593184 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.593161 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 02:22:08.670776 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.670744 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:08.680426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.680391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:08.725667 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.725628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hmp\" (UniqueName: \"kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.725862 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.725705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.798698 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.798666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:08.826858 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.826791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.827008 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.826859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hmp\" (UniqueName: \"kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.827517 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.827497 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.839818 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.839794 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hmp\" (UniqueName: \"kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp\") pod \"limitador-limitador-64c94fd64f-699g5\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:08.902015 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:08.901987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:09.156882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.156860 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:09.158583 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:22:09.158550 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a17f3d_8be7_4b83_bca3_7c9506ea35cf.slice/crio-cec21d8ab4832633aff0872f4b4088400bb113891c723c63ba99bb11864cc6ba WatchSource:0}: Error finding container cec21d8ab4832633aff0872f4b4088400bb113891c723c63ba99bb11864cc6ba: Status 404 returned error can't find the container with id cec21d8ab4832633aff0872f4b4088400bb113891c723c63ba99bb11864cc6ba Jul 10 02:22:09.415541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.415457 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:09.515958 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.515930 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:09.539092 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.539055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:09.542166 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.542146 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:09.544579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.544559 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-78z48\"" Jul 10 02:22:09.549712 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.549689 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:09.634515 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.634487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8tf\" (UniqueName: \"kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf\") pod \"authorino-75d556bd77-h7dpj\" (UID: \"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23\") " pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:09.736100 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.736018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8tf\" (UniqueName: \"kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf\") pod \"authorino-75d556bd77-h7dpj\" (UID: \"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23\") " pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:09.745039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.745010 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8tf\" (UniqueName: \"kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf\") pod \"authorino-75d556bd77-h7dpj\" (UID: \"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23\") " pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:09.852955 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.852729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:09.992119 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:09.991007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" event={"ID":"61a17f3d-8be7-4b83-bca3-7c9506ea35cf","Type":"ContainerStarted","Data":"cec21d8ab4832633aff0872f4b4088400bb113891c723c63ba99bb11864cc6ba"} Jul 10 02:22:10.047989 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:10.047965 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:10.050157 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:22:10.050123 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ff8f65_0f8e_42eb_b5d7_5163ae140a23.slice/crio-e1d8d6d1afae1b135728585523614c2675c74e89fb11c2f31a62df38c4e6254f WatchSource:0}: Error finding container e1d8d6d1afae1b135728585523614c2675c74e89fb11c2f31a62df38c4e6254f: Status 404 returned error can't find the container with id e1d8d6d1afae1b135728585523614c2675c74e89fb11c2f31a62df38c4e6254f Jul 10 02:22:10.999700 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:10.999606 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7dpj" event={"ID":"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23","Type":"ContainerStarted","Data":"e1d8d6d1afae1b135728585523614c2675c74e89fb11c2f31a62df38c4e6254f"} Jul 10 02:22:14.020596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:14.020555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7dpj" event={"ID":"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23","Type":"ContainerStarted","Data":"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977"} Jul 10 02:22:14.022144 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:14.022113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" event={"ID":"61a17f3d-8be7-4b83-bca3-7c9506ea35cf","Type":"ContainerStarted","Data":"26ff3661020d8ed81f9125612ea0ebccdbf9770c18fa863576084052475c5bcb"} Jul 10 02:22:14.022267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:14.022176 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:14.038987 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:14.038944 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-h7dpj" podStartSLOduration=1.238933171 podStartE2EDuration="5.038929203s" totalImagesPullingTime="3.799996032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:14.037430706 +0000 UTC m=+493.097835731" watchObservedRunningTime="2026-07-10 02:22:14.038929203 +0000 UTC m=+493.099334227" Jul 10 02:22:14.060096 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:14.060045 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" podStartSLOduration=1.36949045 podStartE2EDuration="6.060029701s" totalImagesPullingTime="4.690539251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:14.058187407 +0000 UTC m=+493.118592433" watchObservedRunningTime="2026-07-10 02:22:14.060029701 +0000 UTC m=+493.120434727" Jul 10 02:22:25.029373 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:25.029344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:25.577217 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:25.577184 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:25.577666 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:25.577612 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" podUID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" containerName="limitador" containerID="cri-o://26ff3661020d8ed81f9125612ea0ebccdbf9770c18fa863576084052475c5bcb" gracePeriod=30 Jul 10 02:22:26.090897 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.090865 2567 generic.go:356] "Generic (PLEG): container finished" podID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" containerID="26ff3661020d8ed81f9125612ea0ebccdbf9770c18fa863576084052475c5bcb" exitCode=0 Jul 10 02:22:26.091249 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.090949 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" event={"ID":"61a17f3d-8be7-4b83-bca3-7c9506ea35cf","Type":"ContainerDied","Data":"26ff3661020d8ed81f9125612ea0ebccdbf9770c18fa863576084052475c5bcb"} Jul 10 02:22:26.141470 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.141410 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:26.288041 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.288007 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file\") pod \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " Jul 10 02:22:26.288216 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.288050 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7hmp\" (UniqueName: \"kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp\") pod \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\" (UID: \"61a17f3d-8be7-4b83-bca3-7c9506ea35cf\") " Jul 10 02:22:26.288440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.288412 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file" (OuterVolumeSpecName: "config-file") pod "61a17f3d-8be7-4b83-bca3-7c9506ea35cf" (UID: "61a17f3d-8be7-4b83-bca3-7c9506ea35cf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 02:22:26.290275 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.290249 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp" (OuterVolumeSpecName: "kube-api-access-w7hmp") pod "61a17f3d-8be7-4b83-bca3-7c9506ea35cf" (UID: "61a17f3d-8be7-4b83-bca3-7c9506ea35cf"). InnerVolumeSpecName "kube-api-access-w7hmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:22:26.389128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.389094 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-config-file\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:22:26.389128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:26.389122 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7hmp\" (UniqueName: \"kubernetes.io/projected/61a17f3d-8be7-4b83-bca3-7c9506ea35cf-kube-api-access-w7hmp\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:22:27.097689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.097662 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" Jul 10 02:22:27.098163 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.097664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-699g5" event={"ID":"61a17f3d-8be7-4b83-bca3-7c9506ea35cf","Type":"ContainerDied","Data":"cec21d8ab4832633aff0872f4b4088400bb113891c723c63ba99bb11864cc6ba"} Jul 10 02:22:27.098163 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.097800 2567 scope.go:117] "RemoveContainer" containerID="26ff3661020d8ed81f9125612ea0ebccdbf9770c18fa863576084052475c5bcb" Jul 10 02:22:27.119020 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.118998 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:27.122717 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.122693 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-699g5"] Jul 10 02:22:27.473395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:27.473314 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" path="/var/lib/kubelet/pods/61a17f3d-8be7-4b83-bca3-7c9506ea35cf/volumes" Jul 10 02:22:28.186975 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.186934 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:28.284590 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.284558 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:28.648592 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.648562 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l"] Jul 10 02:22:28.648960 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.648946 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" containerName="limitador" Jul 10 02:22:28.649012 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.648962 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" containerName="limitador" Jul 10 02:22:28.649047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.649022 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a17f3d-8be7-4b83-bca3-7c9506ea35cf" containerName="limitador" Jul 10 02:22:28.653399 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.653382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.655898 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.655874 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 10 02:22:28.656143 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.656125 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-429xm\"" Jul 10 02:22:28.656224 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.656179 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 02:22:28.656820 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.656799 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 02:22:28.660561 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.660539 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l"] Jul 10 02:22:28.679321 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.679298 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:28.809325 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.809295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpnz2\" (UniqueName: \"kubernetes.io/projected/38a3a15b-6b4a-408e-8180-0307041e2af6-kube-api-access-qpnz2\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.809497 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.809337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38a3a15b-6b4a-408e-8180-0307041e2af6-data\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.910399 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.910315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpnz2\" (UniqueName: \"kubernetes.io/projected/38a3a15b-6b4a-408e-8180-0307041e2af6-kube-api-access-qpnz2\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.910399 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.910354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38a3a15b-6b4a-408e-8180-0307041e2af6-data\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.910701 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.910686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/38a3a15b-6b4a-408e-8180-0307041e2af6-data\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.922381 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.922356 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpnz2\" (UniqueName: \"kubernetes.io/projected/38a3a15b-6b4a-408e-8180-0307041e2af6-kube-api-access-qpnz2\") pod \"postgres-69fb4594cf-bhn7l\" (UID: \"38a3a15b-6b4a-408e-8180-0307041e2af6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:28.966941 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:28.966917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:29.112100 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:29.112074 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l"] Jul 10 02:22:29.113354 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:22:29.113326 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a3a15b_6b4a_408e_8180_0307041e2af6.slice/crio-bbb2bf467dc13c4ce61f4d5cda999e3440ebad094834f460286a852a2735c2b4 WatchSource:0}: Error finding container bbb2bf467dc13c4ce61f4d5cda999e3440ebad094834f460286a852a2735c2b4: Status 404 returned error can't find the container with id bbb2bf467dc13c4ce61f4d5cda999e3440ebad094834f460286a852a2735c2b4 Jul 10 02:22:30.118679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:30.118628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" event={"ID":"38a3a15b-6b4a-408e-8180-0307041e2af6","Type":"ContainerStarted","Data":"bbb2bf467dc13c4ce61f4d5cda999e3440ebad094834f460286a852a2735c2b4"} Jul 10 02:22:35.153443 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:35.153403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" event={"ID":"38a3a15b-6b4a-408e-8180-0307041e2af6","Type":"ContainerStarted","Data":"687709728a5dd4b84647a97176403c53c6f422d7b606373c7bc8e2496739d54e"} Jul 10 02:22:35.153863 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:35.153461 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:35.170248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:35.170205 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" podStartSLOduration=1.886039449 podStartE2EDuration="7.170191711s" totalImagesPullingTime="5.284152262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:35.169463659 +0000 UTC m=+514.229868683" watchObservedRunningTime="2026-07-10 02:22:35.170191711 +0000 UTC m=+514.230596736" Jul 10 02:22:41.188598 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:41.188570 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bhn7l" Jul 10 02:22:41.523073 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:41.523043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:41.649165 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:41.649130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:43.670670 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:43.670606 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:43.671153 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:43.670826 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-h7dpj" podUID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" containerName="authorino" containerID="cri-o://9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977" gracePeriod=30 Jul 10 02:22:43.922580 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:43.922513 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:43.940099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:43.940074 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k8tf\" (UniqueName: \"kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf\") pod \"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23\" (UID: \"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23\") " Jul 10 02:22:43.942548 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:43.942521 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf" (OuterVolumeSpecName: "kube-api-access-9k8tf") pod "b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" (UID: "b2ff8f65-0f8e-42eb-b5d7-5163ae140a23"). InnerVolumeSpecName "kube-api-access-9k8tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:22:44.040830 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.040801 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k8tf\" (UniqueName: \"kubernetes.io/projected/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23-kube-api-access-9k8tf\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:22:44.202422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.202326 2567 generic.go:356] "Generic (PLEG): container finished" podID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" containerID="9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977" exitCode=0 Jul 10 02:22:44.202422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.202370 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7dpj" Jul 10 02:22:44.202703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.202419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7dpj" event={"ID":"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23","Type":"ContainerDied","Data":"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977"} Jul 10 02:22:44.202703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.202469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7dpj" event={"ID":"b2ff8f65-0f8e-42eb-b5d7-5163ae140a23","Type":"ContainerDied","Data":"e1d8d6d1afae1b135728585523614c2675c74e89fb11c2f31a62df38c4e6254f"} Jul 10 02:22:44.202703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.202494 2567 scope.go:117] "RemoveContainer" containerID="9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977" Jul 10 02:22:44.211881 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.211866 2567 scope.go:117] "RemoveContainer" containerID="9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977" Jul 10 02:22:44.212128 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:22:44.212110 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977\": container with ID starting with 9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977 not found: ID does not exist" containerID="9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977" Jul 10 02:22:44.212174 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.212137 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977"} err="failed to get container status \"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977\": rpc error: code = NotFound desc = could not find container \"9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977\": container with ID starting with 9e7273b8fe16d2f4a57ffa9002728786298c176e49957dbdeeddab891d8ea977 not found: ID does not exist" Jul 10 02:22:44.223999 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.223973 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:44.227045 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:44.227026 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7dpj"] Jul 10 02:22:45.473585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:45.473550 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" path="/var/lib/kubelet/pods/b2ff8f65-0f8e-42eb-b5d7-5163ae140a23/volumes" Jul 10 02:22:48.366803 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.366761 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:48.384463 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.384431 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:22:48.384852 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.384837 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" containerName="authorino" Jul 10 02:22:48.384907 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.384855 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" containerName="authorino" Jul 10 02:22:48.384944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.384911 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ff8f65-0f8e-42eb-b5d7-5163ae140a23" containerName="authorino" Jul 10 02:22:48.468157 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.468122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:48.540901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.540859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:48.574641 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.574616 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:22:48.574779 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.574739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.576693 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.576667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2th58\" (UniqueName: \"kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.576816 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.576730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.577421 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.577402 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 02:22:48.577530 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.577511 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qqsb\"" Jul 10 02:22:48.577593 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.577516 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 02:22:48.649846 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.649760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:48.677488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.677458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2th58\" (UniqueName: \"kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.677625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.677499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.680082 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.680056 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.685486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.685466 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2th58\" (UniqueName: \"kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58\") pod \"maas-controller-76bfc98c9f-xg8c7\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.829366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.829329 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:22:48.862387 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.862350 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:22:48.862546 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.862461 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.878940 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.878913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vsh\" (UniqueName: \"kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.879042 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.878985 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.885544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.885525 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:48.980023 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.979992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vsh\" (UniqueName: \"kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.980197 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.980070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.982637 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.982616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:48.988529 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:48.988498 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vsh\" (UniqueName: \"kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh\") pod \"maas-controller-55fc688ddd-5v2fg\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:49.046844 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:49.046815 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:22:49.048956 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:22:49.048929 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bb6de3_cb1a_4d84_adb0_51fe84a4501d.slice/crio-e52176882cb10f78dc70b7292b80ef932685f9049e4c9b340fa81118c4cb8511 WatchSource:0}: Error finding container e52176882cb10f78dc70b7292b80ef932685f9049e4c9b340fa81118c4cb8511: Status 404 returned error can't find the container with id e52176882cb10f78dc70b7292b80ef932685f9049e4c9b340fa81118c4cb8511 Jul 10 02:22:49.173823 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:49.173731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:49.230914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:49.230871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" event={"ID":"30bb6de3-cb1a-4d84-adb0-51fe84a4501d","Type":"ContainerStarted","Data":"e52176882cb10f78dc70b7292b80ef932685f9049e4c9b340fa81118c4cb8511"} Jul 10 02:22:49.345187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:49.345161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:22:49.347113 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:22:49.347075 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838ff8cd_4a90_44f5_9336_5faba3f9778d.slice/crio-a0eeb72b0dd1ae25ca78e8d3e65545ec641f4b1edf9481e93e0c30b6ff92b629 WatchSource:0}: Error finding container a0eeb72b0dd1ae25ca78e8d3e65545ec641f4b1edf9481e93e0c30b6ff92b629: Status 404 returned error can't find the container with id a0eeb72b0dd1ae25ca78e8d3e65545ec641f4b1edf9481e93e0c30b6ff92b629 Jul 10 02:22:49.808965 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:49.808924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:50.240039 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:50.239945 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" event={"ID":"838ff8cd-4a90-44f5-9336-5faba3f9778d","Type":"ContainerStarted","Data":"a0eeb72b0dd1ae25ca78e8d3e65545ec641f4b1edf9481e93e0c30b6ff92b629"} Jul 10 02:22:51.599848 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:51.599816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:51.693607 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:51.693511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:22:52.254641 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.254601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" event={"ID":"838ff8cd-4a90-44f5-9336-5faba3f9778d","Type":"ContainerStarted","Data":"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a"} Jul 10 02:22:52.254842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.254694 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:22:52.256252 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.256228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" event={"ID":"30bb6de3-cb1a-4d84-adb0-51fe84a4501d","Type":"ContainerStarted","Data":"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90"} Jul 10 02:22:52.256392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.256279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:22:52.293704 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.293639 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" podStartSLOduration=2.282047677 podStartE2EDuration="4.293624878s" totalImagesPullingTime="2.011577201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:52.290804821 +0000 UTC m=+531.351209866" watchObservedRunningTime="2026-07-10 02:22:52.293624878 +0000 UTC m=+531.354029937" Jul 10 02:22:52.318728 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:22:52.318683 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" podStartSLOduration=1.997523962 podStartE2EDuration="4.318667587s" totalImagesPullingTime="2.321143625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:52.316335584 +0000 UTC m=+531.376740635" watchObservedRunningTime="2026-07-10 02:22:52.318667587 +0000 UTC m=+531.379072609" Jul 10 02:23:03.268509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.268479 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:23:03.269029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.268568 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:23:03.378191 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.378153 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:23:03.378429 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.378376 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" podUID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" containerName="manager" containerID="cri-o://36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90" gracePeriod=30 Jul 10 02:23:03.638268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.638245 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:23:03.686068 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.686036 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert\") pod \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " Jul 10 02:23:03.686264 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.686133 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2th58\" (UniqueName: \"kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58\") pod \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\" (UID: \"30bb6de3-cb1a-4d84-adb0-51fe84a4501d\") " Jul 10 02:23:03.688287 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.688254 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "30bb6de3-cb1a-4d84-adb0-51fe84a4501d" (UID: "30bb6de3-cb1a-4d84-adb0-51fe84a4501d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:23:03.688390 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.688323 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58" (OuterVolumeSpecName: "kube-api-access-2th58") pod "30bb6de3-cb1a-4d84-adb0-51fe84a4501d" (UID: "30bb6de3-cb1a-4d84-adb0-51fe84a4501d"). InnerVolumeSpecName "kube-api-access-2th58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:23:03.787789 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.787734 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-webhook-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:23:03.787789 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:03.787780 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2th58\" (UniqueName: \"kubernetes.io/projected/30bb6de3-cb1a-4d84-adb0-51fe84a4501d-kube-api-access-2th58\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:23:04.324066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.324035 2567 generic.go:356] "Generic (PLEG): container finished" podID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" containerID="36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90" exitCode=0 Jul 10 02:23:04.324509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.324083 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" Jul 10 02:23:04.324509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.324125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" event={"ID":"30bb6de3-cb1a-4d84-adb0-51fe84a4501d","Type":"ContainerDied","Data":"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90"} Jul 10 02:23:04.324509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.324185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76bfc98c9f-xg8c7" event={"ID":"30bb6de3-cb1a-4d84-adb0-51fe84a4501d","Type":"ContainerDied","Data":"e52176882cb10f78dc70b7292b80ef932685f9049e4c9b340fa81118c4cb8511"} Jul 10 02:23:04.324509 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.324212 2567 scope.go:117] "RemoveContainer" containerID="36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90" Jul 10 02:23:04.341132 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.341107 2567 scope.go:117] "RemoveContainer" containerID="36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90" Jul 10 02:23:04.341411 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:23:04.341393 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90\": container with ID starting with 36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90 not found: ID does not exist" containerID="36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90" Jul 10 02:23:04.341486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.341418 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90"} err="failed to get container status \"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90\": rpc error: code = NotFound desc = could not find container \"36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90\": container with ID starting with 36d787c1dffe96cccb59b44d18d970a2f2b06e85a7cd7e8bf96bca7ff52f8f90 not found: ID does not exist" Jul 10 02:23:04.352287 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.352262 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:23:04.358645 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:04.358617 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76bfc98c9f-xg8c7"] Jul 10 02:23:05.475013 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:05.474979 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" path="/var/lib/kubelet/pods/30bb6de3-cb1a-4d84-adb0-51fe84a4501d/volumes" Jul 10 02:23:22.421403 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:22.421364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:23.045706 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.045668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:23.142265 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.142230 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7698785bc5-fldfw"] Jul 10 02:23:23.142621 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.142609 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" containerName="manager" Jul 10 02:23:23.142705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.142623 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" containerName="manager" Jul 10 02:23:23.142745 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.142707 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="30bb6de3-cb1a-4d84-adb0-51fe84a4501d" containerName="manager" Jul 10 02:23:23.148718 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.148690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.151681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.151627 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 10 02:23:23.152436 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.152412 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-scvcw\"" Jul 10 02:23:23.174359 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.174330 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7698785bc5-fldfw"] Jul 10 02:23:23.236262 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.236232 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:23.260807 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.260771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-maas-api-tls\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.260971 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.260820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-openshift-service-ca\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.260971 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.260926 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgh9g\" (UniqueName: \"kubernetes.io/projected/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-kube-api-access-rgh9g\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.362121 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.362045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgh9g\" (UniqueName: \"kubernetes.io/projected/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-kube-api-access-rgh9g\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.362121 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.362107 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-maas-api-tls\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.362299 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.362144 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-openshift-service-ca\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.362817 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.362782 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-openshift-service-ca\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.364812 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.364742 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-maas-api-tls\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.370564 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.370541 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgh9g\" (UniqueName: \"kubernetes.io/projected/5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca-kube-api-access-rgh9g\") pod \"maas-api-7698785bc5-fldfw\" (UID: \"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca\") " pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.460212 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.460165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:23.533979 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.533845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:23.617473 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.617445 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7698785bc5-fldfw"] Jul 10 02:23:23.620336 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:23:23.620305 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5753aaa8_4f45_4fd4_aaf5_8bfa972bd6ca.slice/crio-9011a84cf643155d921401aed2bdb7d893df462b947f7951d3e0272c1be35a80 WatchSource:0}: Error finding container 9011a84cf643155d921401aed2bdb7d893df462b947f7951d3e0272c1be35a80: Status 404 returned error can't find the container with id 9011a84cf643155d921401aed2bdb7d893df462b947f7951d3e0272c1be35a80 Jul 10 02:23:23.627241 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.627210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:23.647757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.647724 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gtbmq"] Jul 10 02:23:23.653680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.653638 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.656799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.656783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 02:23:23.667594 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.667569 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gtbmq"] Jul 10 02:23:23.675293 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.675268 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wgcxm"] Jul 10 02:23:23.679577 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.679556 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.682215 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.682189 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gq82f\"" Jul 10 02:23:23.692764 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.692737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wgcxm"] Jul 10 02:23:23.766228 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.766189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tx5\" (UniqueName: \"kubernetes.io/projected/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-kube-api-access-l7tx5\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.766228 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.766231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471019b9-49fc-49ae-8773-0746d28f2f4d-plugins-config-volume\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.766439 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.766264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbr9\" (UniqueName: \"kubernetes.io/projected/471019b9-49fc-49ae-8773-0746d28f2f4d-kube-api-access-jvbr9\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.766439 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.766303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.867298 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.867203 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tx5\" (UniqueName: \"kubernetes.io/projected/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-kube-api-access-l7tx5\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.867298 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.867250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471019b9-49fc-49ae-8773-0746d28f2f4d-plugins-config-volume\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.867298 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.867296 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbr9\" (UniqueName: \"kubernetes.io/projected/471019b9-49fc-49ae-8773-0746d28f2f4d-kube-api-access-jvbr9\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.867585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.867329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.868128 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.868102 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.868230 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.868149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/471019b9-49fc-49ae-8773-0746d28f2f4d-plugins-config-volume\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.877515 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.877490 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tx5\" (UniqueName: \"kubernetes.io/projected/7b65d0a4-11bd-4b20-a4ca-6d5d8175e177-kube-api-access-l7tx5\") pod \"payload-pre-processing-7964457696-gtbmq\" (UID: \"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177\") " pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.877619 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.877559 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbr9\" (UniqueName: \"kubernetes.io/projected/471019b9-49fc-49ae-8773-0746d28f2f4d-kube-api-access-jvbr9\") pod \"payload-processing-58f86c7798-wgcxm\" (UID: \"471019b9-49fc-49ae-8773-0746d28f2f4d\") " pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:23.964738 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.964699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:23.990401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:23.990344 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:24.122508 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:24.122478 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gtbmq"] Jul 10 02:23:24.124309 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:23:24.124273 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b65d0a4_11bd_4b20_a4ca_6d5d8175e177.slice/crio-2310cea31ab322e0a86c82be57aa963d1ee922db64941447d7ab7aef8b9d18a8 WatchSource:0}: Error finding container 2310cea31ab322e0a86c82be57aa963d1ee922db64941447d7ab7aef8b9d18a8: Status 404 returned error can't find the container with id 2310cea31ab322e0a86c82be57aa963d1ee922db64941447d7ab7aef8b9d18a8 Jul 10 02:23:24.157295 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:24.157270 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-wgcxm"] Jul 10 02:23:24.159075 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:23:24.159045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471019b9_49fc_49ae_8773_0746d28f2f4d.slice/crio-69e534bf15dc6000aa22a25135ceef62f112d1cfa5ae40a0d851ad7876c8c855 WatchSource:0}: Error finding container 69e534bf15dc6000aa22a25135ceef62f112d1cfa5ae40a0d851ad7876c8c855: Status 404 returned error can't find the container with id 69e534bf15dc6000aa22a25135ceef62f112d1cfa5ae40a0d851ad7876c8c855 Jul 10 02:23:24.436503 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:24.436424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" event={"ID":"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177","Type":"ContainerStarted","Data":"2310cea31ab322e0a86c82be57aa963d1ee922db64941447d7ab7aef8b9d18a8"} Jul 10 02:23:24.437723 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:24.437631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" event={"ID":"471019b9-49fc-49ae-8773-0746d28f2f4d","Type":"ContainerStarted","Data":"69e534bf15dc6000aa22a25135ceef62f112d1cfa5ae40a0d851ad7876c8c855"} Jul 10 02:23:24.438879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:24.438853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" event={"ID":"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca","Type":"ContainerStarted","Data":"9011a84cf643155d921401aed2bdb7d893df462b947f7951d3e0272c1be35a80"} Jul 10 02:23:26.457453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.457417 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" event={"ID":"7b65d0a4-11bd-4b20-a4ca-6d5d8175e177","Type":"ContainerStarted","Data":"6b1a1a83e20423305eb4fa5a954546d6316b85ec846046c11f04a3c935ee2bf6"} Jul 10 02:23:26.457914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.457524 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:26.459191 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.459161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" event={"ID":"471019b9-49fc-49ae-8773-0746d28f2f4d","Type":"ContainerStarted","Data":"030f03cea8d491ec9ee99ded04ee9cc867eb08fe77aa241f2053229d3f40c23f"} Jul 10 02:23:26.459339 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.459231 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:26.460604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.460580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" event={"ID":"5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca","Type":"ContainerStarted","Data":"635c25f07c388c8199a6b31a96e5d6ba8207035661ffe71e419385c28d4cdbf8"} Jul 10 02:23:26.460721 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.460628 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:26.476323 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.476283 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" podStartSLOduration=1.8094113809999999 podStartE2EDuration="3.476269992s" totalImagesPullingTime="1.666858611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:26.474364367 +0000 UTC m=+565.534769405" watchObservedRunningTime="2026-07-10 02:23:26.476269992 +0000 UTC m=+565.536675017" Jul 10 02:23:26.492545 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.492499 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" podStartSLOduration=1.863372051 podStartE2EDuration="3.492488247s" totalImagesPullingTime="1.629116196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:26.490445988 +0000 UTC m=+565.550851039" watchObservedRunningTime="2026-07-10 02:23:26.492488247 +0000 UTC m=+565.552893272" Jul 10 02:23:26.510133 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:26.510090 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" podStartSLOduration=1.341615634 podStartE2EDuration="3.510075529s" totalImagesPullingTime="2.168459895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:26.508259168 +0000 UTC m=+565.568664202" watchObservedRunningTime="2026-07-10 02:23:26.510075529 +0000 UTC m=+565.570480554" Jul 10 02:23:32.471063 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:32.471035 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7698785bc5-fldfw" Jul 10 02:23:33.490560 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:33.490525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:33.590992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:33.590949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:37.467314 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:37.467272 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" podUID="7b65d0a4-11bd-4b20-a4ca-6d5d8175e177" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.57:9004: connect: connection refused" Jul 10 02:23:37.474979 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:37.474945 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-wgcxm" Jul 10 02:23:41.604040 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:41.604002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:45.532420 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:45.532379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:47.466713 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:47.466685 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-gtbmq" Jul 10 02:23:55.488395 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.488367 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp"] Jul 10 02:23:55.491713 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.491696 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.496353 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.496331 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 02:23:55.496494 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.496418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g7bnd\"" Jul 10 02:23:55.496494 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.496464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 02:23:55.496673 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.496512 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 02:23:55.520696 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.520639 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp"] Jul 10 02:23:55.537153 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.537112 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:55.540324 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.540433 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.540433 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.540512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.540512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rd9\" (UniqueName: \"kubernetes.io/projected/e1c8a446-b6ad-4eb9-b358-17e65439cf41-kube-api-access-87rd9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.540576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.540519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.641872 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.641840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.641900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.641932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.641962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.641999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.642029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rd9\" (UniqueName: \"kubernetes.io/projected/e1c8a446-b6ad-4eb9-b358-17e65439cf41-kube-api-access-87rd9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.642365 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642422 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.642399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.642727 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.642696 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.644521 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.644489 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1c8a446-b6ad-4eb9-b358-17e65439cf41-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.644726 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.644710 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1c8a446-b6ad-4eb9-b358-17e65439cf41-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.657372 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.657352 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rd9\" (UniqueName: \"kubernetes.io/projected/e1c8a446-b6ad-4eb9-b358-17e65439cf41-kube-api-access-87rd9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9jszp\" (UID: \"e1c8a446-b6ad-4eb9-b358-17e65439cf41\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.803361 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.803326 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:23:55.953408 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:55.953383 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp"] Jul 10 02:23:55.953961 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:23:55.953936 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c8a446_b6ad_4eb9_b358_17e65439cf41.slice/crio-755844f878b63d527dc7b54c8bd751afb0d491b623a26d277bbc0fe1fb22c318 WatchSource:0}: Error finding container 755844f878b63d527dc7b54c8bd751afb0d491b623a26d277bbc0fe1fb22c318: Status 404 returned error can't find the container with id 755844f878b63d527dc7b54c8bd751afb0d491b623a26d277bbc0fe1fb22c318 Jul 10 02:23:56.259306 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:56.259269 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:56.371371 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:56.371337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:23:56.633099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:56.632965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" event={"ID":"e1c8a446-b6ad-4eb9-b358-17e65439cf41","Type":"ContainerStarted","Data":"755844f878b63d527dc7b54c8bd751afb0d491b623a26d277bbc0fe1fb22c318"} Jul 10 02:23:57.639294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:57.639257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" event={"ID":"e1c8a446-b6ad-4eb9-b358-17e65439cf41","Type":"ContainerStarted","Data":"63662616ebb2f904fea2feaa47a450e46fc78f9f642e0f239da40ae28ca51f62"} Jul 10 02:23:57.662153 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:23:57.662099 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" podStartSLOduration=1.630377695 podStartE2EDuration="2.662085257s" totalImagesPullingTime="1.031707562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:57.660346461 +0000 UTC m=+596.720751506" watchObservedRunningTime="2026-07-10 02:23:57.662085257 +0000 UTC m=+596.722490318" Jul 10 02:24:01.425045 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:01.425015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:24:01.425469 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:01.425021 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:24:05.803966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:05.803930 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:24:05.804383 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:05.803996 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:24:05.816479 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:05.816451 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:24:06.549528 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:06.549491 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:24:06.701505 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:06.701471 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9jszp" Jul 10 02:24:09.854514 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.854483 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc"] Jul 10 02:24:09.858114 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.858091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.860828 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.860803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 02:24:09.871459 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.871426 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc"] Jul 10 02:24:09.886702 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.886642 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:24:09.967150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.967150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.967352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwzdg\" (UniqueName: \"kubernetes.io/projected/99218128-fb45-470e-8ed8-0672d39d9edf-kube-api-access-vwzdg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.967352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.967352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99218128-fb45-470e-8ed8-0672d39d9edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:09.967352 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:09.967275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.068744 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.068936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.068936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzdg\" (UniqueName: \"kubernetes.io/projected/99218128-fb45-470e-8ed8-0672d39d9edf-kube-api-access-vwzdg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.068936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.068936 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99218128-fb45-470e-8ed8-0672d39d9edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.069145 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.068973 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.069226 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.069182 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.069291 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.069254 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.069383 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.069366 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.071345 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.071288 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99218128-fb45-470e-8ed8-0672d39d9edf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.071985 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.071960 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99218128-fb45-470e-8ed8-0672d39d9edf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.077576 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.077555 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwzdg\" (UniqueName: \"kubernetes.io/projected/99218128-fb45-470e-8ed8-0672d39d9edf-kube-api-access-vwzdg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc\" (UID: \"99218128-fb45-470e-8ed8-0672d39d9edf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.174442 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.174368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:10.325691 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.325670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc"] Jul 10 02:24:10.327484 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:24:10.327453 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99218128_fb45_470e_8ed8_0672d39d9edf.slice/crio-9413794827eceb98e699d0e3192b542859dd4dde19098b5957ab5494cca2bf0b WatchSource:0}: Error finding container 9413794827eceb98e699d0e3192b542859dd4dde19098b5957ab5494cca2bf0b: Status 404 returned error can't find the container with id 9413794827eceb98e699d0e3192b542859dd4dde19098b5957ab5494cca2bf0b Jul 10 02:24:10.328883 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.328866 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 02:24:10.715133 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.715089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" event={"ID":"99218128-fb45-470e-8ed8-0672d39d9edf","Type":"ContainerStarted","Data":"474aa86b1a42dc78ee2ec87cf002cade07725dc3dc702e043cdb8823212d5264"} Jul 10 02:24:10.715323 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.715161 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" event={"ID":"99218128-fb45-470e-8ed8-0672d39d9edf","Type":"ContainerStarted","Data":"9413794827eceb98e699d0e3192b542859dd4dde19098b5957ab5494cca2bf0b"} Jul 10 02:24:10.737087 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:10.737045 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" podStartSLOduration=1.556278663 podStartE2EDuration="1.737031161s" totalImagesPullingTime="180.752498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:10.73449708 +0000 UTC m=+609.794902135" watchObservedRunningTime="2026-07-10 02:24:10.737031161 +0000 UTC m=+609.797436186" Jul 10 02:24:20.175055 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.174969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:20.175450 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.175112 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:20.181460 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.181437 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9"] Jul 10 02:24:20.185111 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.185096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.188034 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.188013 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 02:24:20.188126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.188071 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:20.203075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.203046 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9"] Jul 10 02:24:20.211711 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.211685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:24:20.261678 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.261842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.261842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261725 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.261842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.261842 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnn7l\" (UniqueName: \"kubernetes.io/projected/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-kube-api-access-fnn7l\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.262026 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.261915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362835 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnn7l\" (UniqueName: \"kubernetes.io/projected/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-kube-api-access-fnn7l\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.362943 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.362872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.363256 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.363229 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.363318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.363270 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.363318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.363282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.365234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.365207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.365394 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.365375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.376018 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.375987 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnn7l\" (UniqueName: \"kubernetes.io/projected/d415c8d0-bb47-44d1-aba8-22b54c44a9cb-kube-api-access-fnn7l\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4wqz9\" (UID: \"d415c8d0-bb47-44d1-aba8-22b54c44a9cb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.495358 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.495263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:20.640959 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.640932 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9"] Jul 10 02:24:20.642395 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:24:20.642368 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd415c8d0_bb47_44d1_aba8_22b54c44a9cb.slice/crio-25ee4f5902de70ee7669e0cf699fcf6bf26c6b4f0e87c6bae2c08167fda05351 WatchSource:0}: Error finding container 25ee4f5902de70ee7669e0cf699fcf6bf26c6b4f0e87c6bae2c08167fda05351: Status 404 returned error can't find the container with id 25ee4f5902de70ee7669e0cf699fcf6bf26c6b4f0e87c6bae2c08167fda05351 Jul 10 02:24:20.775631 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.775592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" event={"ID":"d415c8d0-bb47-44d1-aba8-22b54c44a9cb","Type":"ContainerStarted","Data":"25ee4f5902de70ee7669e0cf699fcf6bf26c6b4f0e87c6bae2c08167fda05351"} Jul 10 02:24:20.787172 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:20.787146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc" Jul 10 02:24:21.782712 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:21.782670 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" event={"ID":"d415c8d0-bb47-44d1-aba8-22b54c44a9cb","Type":"ContainerStarted","Data":"0d7efe2498e9a5214bd9e4d9fda8fcb0b9c680c70156c56a213c5bf0813bda64"} Jul 10 02:24:21.803703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:21.803626 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" podStartSLOduration=1.588096462 podStartE2EDuration="1.803607937s" totalImagesPullingTime="215.511475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:21.801670274 +0000 UTC m=+620.862075322" watchObservedRunningTime="2026-07-10 02:24:21.803607937 +0000 UTC m=+620.864012962" Jul 10 02:24:29.394496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:29.394463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:24:30.496169 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:30.496132 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:30.496646 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:30.496196 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:30.508818 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:30.508792 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:24:30.850817 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:24:30.850788 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4wqz9" Jul 10 02:25:46.252122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:46.252079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:46.350361 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:46.350320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:51.456448 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:51.456414 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:51.568427 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:51.568396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:52.679827 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:52.679745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:52.769731 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:52.769702 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:57.449227 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:57.449189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:25:57.551026 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:25:57.550989 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:26:06.901409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:26:06.901370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:26:06.963678 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:26:06.963624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:26:56.354537 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:26:56.354500 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:03.660231 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:03.660186 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:03.788124 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:03.788082 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:27:03.788643 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:03.788609 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" podUID="838ff8cd-4a90-44f5-9336-5faba3f9778d" containerName="manager" containerID="cri-o://edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a" gracePeriod=30 Jul 10 02:27:04.049994 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.049968 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:27:04.137476 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.137430 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75vsh\" (UniqueName: \"kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh\") pod \"838ff8cd-4a90-44f5-9336-5faba3f9778d\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " Jul 10 02:27:04.137645 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.137559 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert\") pod \"838ff8cd-4a90-44f5-9336-5faba3f9778d\" (UID: \"838ff8cd-4a90-44f5-9336-5faba3f9778d\") " Jul 10 02:27:04.139696 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.139665 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "838ff8cd-4a90-44f5-9336-5faba3f9778d" (UID: "838ff8cd-4a90-44f5-9336-5faba3f9778d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 02:27:04.139696 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.139690 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh" (OuterVolumeSpecName: "kube-api-access-75vsh") pod "838ff8cd-4a90-44f5-9336-5faba3f9778d" (UID: "838ff8cd-4a90-44f5-9336-5faba3f9778d"). InnerVolumeSpecName "kube-api-access-75vsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:27:04.238503 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.238411 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/838ff8cd-4a90-44f5-9336-5faba3f9778d-webhook-cert\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:27:04.238503 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.238453 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75vsh\" (UniqueName: \"kubernetes.io/projected/838ff8cd-4a90-44f5-9336-5faba3f9778d-kube-api-access-75vsh\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:27:04.696989 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.696952 2567 generic.go:356] "Generic (PLEG): container finished" podID="838ff8cd-4a90-44f5-9336-5faba3f9778d" containerID="edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a" exitCode=0 Jul 10 02:27:04.696989 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.696998 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" Jul 10 02:27:04.697453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.697042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" event={"ID":"838ff8cd-4a90-44f5-9336-5faba3f9778d","Type":"ContainerDied","Data":"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a"} Jul 10 02:27:04.697453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.697096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-5v2fg" event={"ID":"838ff8cd-4a90-44f5-9336-5faba3f9778d","Type":"ContainerDied","Data":"a0eeb72b0dd1ae25ca78e8d3e65545ec641f4b1edf9481e93e0c30b6ff92b629"} Jul 10 02:27:04.697453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.697121 2567 scope.go:117] "RemoveContainer" containerID="edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a" Jul 10 02:27:04.707287 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.707267 2567 scope.go:117] "RemoveContainer" containerID="edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a" Jul 10 02:27:04.707569 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:27:04.707551 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a\": container with ID starting with edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a not found: ID does not exist" containerID="edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a" Jul 10 02:27:04.707643 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.707578 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a"} err="failed to get container status \"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a\": rpc error: code = NotFound desc = could not find container \"edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a\": container with ID starting with edacf11b9448327b31b5ad30e419f1bf09de621eaa12f25010ba6bf6e1905f1a not found: ID does not exist" Jul 10 02:27:04.717445 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.717422 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:27:04.720846 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:04.720823 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-5v2fg"] Jul 10 02:27:05.467797 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.467766 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:05.473380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.473357 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="838ff8cd-4a90-44f5-9336-5faba3f9778d" path="/var/lib/kubelet/pods/838ff8cd-4a90-44f5-9336-5faba3f9778d/volumes" Jul 10 02:27:05.598346 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.598318 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55fc688ddd-mg7q7"] Jul 10 02:27:05.598735 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.598722 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838ff8cd-4a90-44f5-9336-5faba3f9778d" containerName="manager" Jul 10 02:27:05.598785 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.598737 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="838ff8cd-4a90-44f5-9336-5faba3f9778d" containerName="manager" Jul 10 02:27:05.598821 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.598814 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="838ff8cd-4a90-44f5-9336-5faba3f9778d" containerName="manager" Jul 10 02:27:05.603272 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.603254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.606787 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.606762 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qqsb\"" Jul 10 02:27:05.606938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.606790 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 02:27:05.606938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.606762 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 02:27:05.615317 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.615296 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-mg7q7"] Jul 10 02:27:05.752705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.752679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9dbd429-57da-4cb0-afda-95dd5388a2e9-webhook-cert\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.753066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.752714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkc2\" (UniqueName: \"kubernetes.io/projected/e9dbd429-57da-4cb0-afda-95dd5388a2e9-kube-api-access-bxkc2\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.854102 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.854067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9dbd429-57da-4cb0-afda-95dd5388a2e9-webhook-cert\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.854102 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.854107 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkc2\" (UniqueName: \"kubernetes.io/projected/e9dbd429-57da-4cb0-afda-95dd5388a2e9-kube-api-access-bxkc2\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.856752 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.856727 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9dbd429-57da-4cb0-afda-95dd5388a2e9-webhook-cert\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.863029 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.863006 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkc2\" (UniqueName: \"kubernetes.io/projected/e9dbd429-57da-4cb0-afda-95dd5388a2e9-kube-api-access-bxkc2\") pod \"maas-controller-55fc688ddd-mg7q7\" (UID: \"e9dbd429-57da-4cb0-afda-95dd5388a2e9\") " pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:05.914854 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:05.914824 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:06.056279 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:06.056245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55fc688ddd-mg7q7"] Jul 10 02:27:06.058012 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:27:06.057982 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dbd429_57da_4cb0_afda_95dd5388a2e9.slice/crio-470899226bed27525bdb78a917e361727bd0c8652e559b15b37cd209dbb96c6c WatchSource:0}: Error finding container 470899226bed27525bdb78a917e361727bd0c8652e559b15b37cd209dbb96c6c: Status 404 returned error can't find the container with id 470899226bed27525bdb78a917e361727bd0c8652e559b15b37cd209dbb96c6c Jul 10 02:27:06.712164 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:06.712130 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" event={"ID":"e9dbd429-57da-4cb0-afda-95dd5388a2e9","Type":"ContainerStarted","Data":"c8ace8b7c5512a98568a81be176c7d4d861901085517084203fd80859c15186d"} Jul 10 02:27:06.712331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:06.712179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" event={"ID":"e9dbd429-57da-4cb0-afda-95dd5388a2e9","Type":"ContainerStarted","Data":"470899226bed27525bdb78a917e361727bd0c8652e559b15b37cd209dbb96c6c"} Jul 10 02:27:06.712331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:06.712262 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:06.732361 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:06.732299 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" podStartSLOduration=1.280251286 podStartE2EDuration="1.732284699s" totalImagesPullingTime="452.033413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:27:06.729551229 +0000 UTC m=+785.789956253" watchObservedRunningTime="2026-07-10 02:27:06.732284699 +0000 UTC m=+785.792689723" Jul 10 02:27:17.723785 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:17.723753 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55fc688ddd-mg7q7" Jul 10 02:27:49.298016 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:49.297978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:49.400331 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:49.400296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:49.531566 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:49.531532 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:55.607054 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:55.607008 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:55.715215 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:55.715174 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:55.811065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:55.811026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:27:56.014151 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:27:56.014110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:28:02.072727 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:28:02.072686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:28:02.130560 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:28:02.130523 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:28:03.023847 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:28:03.023804 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:29:01.459581 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:29:01.459550 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:29:01.463868 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:29:01.463835 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:30:15.623485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:30:15.623431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:30:16.764249 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:30:16.764219 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:31:53.039754 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:53.039660 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:31:53.040336 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:53.039886 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" podUID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" containerName="manager" containerID="cri-o://6835d221b524de08f555e0514cc6bdea69fc3a843c3b83ba70583bc016b7b267" gracePeriod=10 Jul 10 02:31:56.347004 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.346969 2567 generic.go:356] "Generic (PLEG): container finished" podID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" containerID="6835d221b524de08f555e0514cc6bdea69fc3a843c3b83ba70583bc016b7b267" exitCode=0 Jul 10 02:31:56.347365 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.347039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" event={"ID":"b5a0f9ce-0717-4882-a496-f42d5bf5cce1","Type":"ContainerDied","Data":"6835d221b524de08f555e0514cc6bdea69fc3a843c3b83ba70583bc016b7b267"} Jul 10 02:31:56.402119 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.402096 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:31:56.549771 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.549737 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume\") pod \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " Jul 10 02:31:56.549771 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.549777 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77lm6\" (UniqueName: \"kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6\") pod \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\" (UID: \"b5a0f9ce-0717-4882-a496-f42d5bf5cce1\") " Jul 10 02:31:56.550187 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.550161 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b5a0f9ce-0717-4882-a496-f42d5bf5cce1" (UID: "b5a0f9ce-0717-4882-a496-f42d5bf5cce1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 02:31:56.552018 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.551998 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6" (OuterVolumeSpecName: "kube-api-access-77lm6") pod "b5a0f9ce-0717-4882-a496-f42d5bf5cce1" (UID: "b5a0f9ce-0717-4882-a496-f42d5bf5cce1"). InnerVolumeSpecName "kube-api-access-77lm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:31:56.651308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.651273 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-extensions-socket-volume\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:31:56.651308 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:56.651304 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77lm6\" (UniqueName: \"kubernetes.io/projected/b5a0f9ce-0717-4882-a496-f42d5bf5cce1-kube-api-access-77lm6\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:31:57.354099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.354055 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" event={"ID":"b5a0f9ce-0717-4882-a496-f42d5bf5cce1","Type":"ContainerDied","Data":"e6949a047ff2e7650e9b2d9b56b48e8697584715a7d76bc08bc293912e9cc9b6"} Jul 10 02:31:57.354099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.354085 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk" Jul 10 02:31:57.354805 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.354132 2567 scope.go:117] "RemoveContainer" containerID="6835d221b524de08f555e0514cc6bdea69fc3a843c3b83ba70583bc016b7b267" Jul 10 02:31:57.379758 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.379730 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:31:57.384063 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.384042 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2v6wk"] Jul 10 02:31:57.473409 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:31:57.473375 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" path="/var/lib/kubelet/pods/b5a0f9ce-0717-4882-a496-f42d5bf5cce1/volumes" Jul 10 02:32:37.137748 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:37.137695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:32:54.249459 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.249419 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d"] Jul 10 02:32:54.249886 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.249874 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" containerName="manager" Jul 10 02:32:54.249886 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.249886 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" containerName="manager" Jul 10 02:32:54.249982 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.249961 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a0f9ce-0717-4882-a496-f42d5bf5cce1" containerName="manager" Jul 10 02:32:54.253096 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.253081 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.255671 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.255637 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f5mnk\"" Jul 10 02:32:54.264369 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.264349 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d"] Jul 10 02:32:54.353563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.353528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b356b6-7e55-4831-a7bd-fd15efd4770c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.353794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.353677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7klm\" (UniqueName: \"kubernetes.io/projected/11b356b6-7e55-4831-a7bd-fd15efd4770c-kube-api-access-s7klm\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.454956 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.454918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7klm\" (UniqueName: \"kubernetes.io/projected/11b356b6-7e55-4831-a7bd-fd15efd4770c-kube-api-access-s7klm\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.455134 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.454977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b356b6-7e55-4831-a7bd-fd15efd4770c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.455374 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.455358 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b356b6-7e55-4831-a7bd-fd15efd4770c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.467009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.466985 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7klm\" (UniqueName: \"kubernetes.io/projected/11b356b6-7e55-4831-a7bd-fd15efd4770c-kube-api-access-s7klm\") pod \"kuadrant-operator-controller-manager-86878c769f-nxq9d\" (UID: \"11b356b6-7e55-4831-a7bd-fd15efd4770c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.564136 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.564045 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:54.710757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:54.710670 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d"] Jul 10 02:32:54.713479 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:32:54.713444 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b356b6_7e55_4831_a7bd_fd15efd4770c.slice/crio-21b38ae0dbf0178d824dc391ab60a5286494a21fc66e4daf9fd5e9e43bc2d1cb WatchSource:0}: Error finding container 21b38ae0dbf0178d824dc391ab60a5286494a21fc66e4daf9fd5e9e43bc2d1cb: Status 404 returned error can't find the container with id 21b38ae0dbf0178d824dc391ab60a5286494a21fc66e4daf9fd5e9e43bc2d1cb Jul 10 02:32:55.681971 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:55.681933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" event={"ID":"11b356b6-7e55-4831-a7bd-fd15efd4770c","Type":"ContainerStarted","Data":"04c73222f964bdd5b860dc5cca2aa64c0bb2b197a7fd5ab7d5b977cc9e3cc2a4"} Jul 10 02:32:55.682382 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:55.681993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" event={"ID":"11b356b6-7e55-4831-a7bd-fd15efd4770c","Type":"ContainerStarted","Data":"21b38ae0dbf0178d824dc391ab60a5286494a21fc66e4daf9fd5e9e43bc2d1cb"} Jul 10 02:32:55.682382 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:55.682066 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:32:55.705368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:32:55.705313 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" podStartSLOduration=1.7052957210000002 podStartE2EDuration="1.705295721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:32:55.701816823 +0000 UTC m=+1134.762221890" watchObservedRunningTime="2026-07-10 02:32:55.705295721 +0000 UTC m=+1134.765700745" Jul 10 02:33:06.689507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:33:06.689432 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nxq9d" Jul 10 02:34:01.495722 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:34:01.495692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:34:01.504383 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:34:01.504353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:34:23.914093 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:34:23.914056 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:35:55.062606 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:35:55.062572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:35:56.333583 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:35:56.333549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:36:07.129440 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:36:07.129399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:38:36.352486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:38:36.352443 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:38:45.563006 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:38:45.562965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:38:53.074837 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:38:53.074798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:01.359083 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:01.358990 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:01.537474 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:01.537444 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:39:01.543893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:01.543871 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:39:06.527513 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:06.527478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:09.527751 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:09.527715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:09.627183 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:09.627142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:09.979802 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:09.979710 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:16.216949 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:16.216910 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:16.324226 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:16.324190 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:16.462924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:16.462880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:16.554855 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:16.554825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:17.565208 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:17.565152 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:17.668356 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:17.668320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:17.766846 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:17.766813 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:18.011157 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:18.011124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:18.421996 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:18.421896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:18.520543 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:18.520503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:20.393946 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:20.393908 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:22.729668 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:22.729517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:22.934883 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:22.934841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:23.077913 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:23.077882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:23.174719 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:23.174689 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:24.883924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:24.883893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:29.182854 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:29.182819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:29.254799 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:29.254766 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:29.397820 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:29.397781 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:29.465139 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:29.465053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:30.492679 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:30.492632 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:30.588482 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:30.588440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:30.688913 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:30.688877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:30.790681 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:30.790631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:31.069148 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:31.069062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:31.166031 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:31.166001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:32.476969 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:32.476925 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:35.659447 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:35.659378 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:36.058025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:36.057989 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:41.847269 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:41.847232 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:41.947262 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:41.947226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:48.359898 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:48.359849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:48.463684 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:48.463635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:48.611727 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:48.611618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:49.240255 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:49.240226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:49.351085 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:49.351035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:49.791983 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:49.791944 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:49.873955 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:49.873929 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:49.946524 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:49.946490 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:50.146512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:50.146484 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:50.462058 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:50.461962 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:50.559181 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:50.559140 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:52.878343 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:52.878310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:54.179296 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:54.179263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:54.357585 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:54.357549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:54.466997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:54.466896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:54.540426 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:54.540396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:39:56.794995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:39:56.794964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:00.540729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:00.540692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:00.641233 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:00.641195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:01.041862 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:01.041821 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:01.142022 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:01.141992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:01.242159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:01.242129 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:02.693924 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:02.693884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:08.579596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:08.579538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:08.636305 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:08.636276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:08.712862 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:08.712830 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:08.811060 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:08.811021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:08.879086 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:08.879010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:09.324780 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:09.324748 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:35.339691 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:35.339638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:41.571069 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:41.571037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:41.632563 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:41.632528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:41.713757 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:41.713725 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:41.816292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:41.816262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:46.089945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:46.089911 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:40:57.710156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:40:57.710120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:03.698391 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:03.698358 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:03.766268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:03.766234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:03.843156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:03.843117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:03.941940 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:03.941906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:14.464586 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:14.464553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:15.305929 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:15.305895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:21.172093 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:21.172050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:21.229396 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:21.229364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:21.306746 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:21.306711 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:21.405853 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:21.405826 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:21.506879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:21.506845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:22.299368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:22.299325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:22.398327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:22.398287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:22.502200 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:22.502168 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:24.176266 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:24.176231 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:30.264388 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:30.264349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:30.326702 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:30.326640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:30.979074 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:30.979040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:37.181491 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:37.181454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:37.281209 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:37.281173 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:37.423273 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:37.423242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:37.743877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:37.743840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:37.852318 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:37.852277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:40.573596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:40.573562 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:40.669328 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:40.669291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:40.815049 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:40.815016 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:41.018088 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:41.018054 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:41.353489 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:41.353400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:41.453534 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:41.453501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:45.112910 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:45.112880 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:45.793199 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:45.793162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:45.892614 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:45.892577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:46.261424 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:46.261392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:52.577557 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:52.577519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:52.634819 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:52.634782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:53.018768 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:53.018733 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:53.383373 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:53.383298 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:53.483811 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:53.483779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:59.520683 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:59.520626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:59.580525 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:59.580487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:41:59.784569 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:41:59.784477 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:00.018713 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:00.018676 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:00.136099 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:00.136017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:00.236930 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:00.236891 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:00.379744 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:00.379714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:01.929754 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:01.929721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:02.029771 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:02.029735 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:06.373488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:06.373451 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:06.472959 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:06.472929 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:06.573506 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:06.573465 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:06.720891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:06.720813 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:12.543453 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:12.543415 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:12.644629 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:12.644592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:19.427510 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:19.427474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:19.727427 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:19.727338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:20.100905 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:20.100875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:22.682463 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:22.682369 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:22.781848 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:22.781815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:22.898348 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:22.898320 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:23.114604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:23.114569 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:23.456388 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:23.456302 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:23.555906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:23.555862 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:26.218877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:26.218834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:26.321926 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:26.321891 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:27.234000 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:27.233964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:37.689103 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:37.689073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:44.281604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:44.281566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:42:44.384860 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:42:44.384822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:04.826485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:04.826452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:05.221483 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:05.221385 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:10.516423 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:10.516389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:10.989259 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:10.989159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:14.112882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:14.112844 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:14.213667 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:14.213630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:16.011908 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:16.011860 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:52.121537 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:52.121503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:43:53.430752 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:43:53.430674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:01.575132 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:01.575098 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:44:01.583169 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:01.583146 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:44:07.953486 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:07.953439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:08.037266 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:08.037230 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:08.267857 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:08.267818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:08.511177 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:08.511143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:09.607997 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:09.607963 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:09.708268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:09.708234 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:09.808414 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:09.808379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:10.607872 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:10.607838 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:10.703912 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:10.703881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:10.803042 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:10.803010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:12.242806 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:12.242771 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:18.003702 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:18.003664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:18.071286 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:18.071255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:18.703452 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:18.703412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:24.896264 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:24.896224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:24.969069 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:24.969034 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:25.048075 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:25.048039 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:35.639293 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:35.639255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:35.997306 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:35.997226 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:44:56.989627 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:44:56.989595 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:03.056544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:03.056511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:03.129814 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:03.129779 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:03.467477 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:03.467396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:03.807731 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:03.807693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:04.224151 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:04.224058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:06.794014 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:06.793973 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:06.894488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:06.894453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:06.993610 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:06.993574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:07.148485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:07.148396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:07.248925 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:07.248891 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:11.122025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:11.121988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:11.516665 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:11.516608 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:11.826875 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:11.826780 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:12.217264 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:12.217165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:14.623009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:14.622978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:14.708396 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:14.708353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:14.784624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:14.784588 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:14.893485 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:14.893389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:15.290747 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:15.290715 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:15.392180 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:15.392150 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:19.190159 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:19.190119 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:27.874224 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:27.874185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:27.974110 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:27.974076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:36.968773 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:36.968739 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:37.069451 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:37.069417 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:45:44.999895 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:45:44.999854 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:10.502427 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:10.502384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:13.959292 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:13.959255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:28.466798 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:28.466759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:29.393572 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:29.393536 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:29.554161 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:29.554126 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:29.966413 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:29.966377 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:30.066624 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:30.066594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:30.248783 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:30.248756 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:46:35.051291 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:46:35.051253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:12.116935 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:12.116848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:12.402375 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:12.402290 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:12.655268 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:12.655182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:12.890310 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:12.890278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:13.337329 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:13.337287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:13.489579 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:13.489546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:13.590870 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:13.590786 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:13.742789 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:13.742759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:19.329254 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:19.329223 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:19.429484 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:19.429452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:19.604798 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:19.604701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:19.857366 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:19.857273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:20.182291 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:20.182201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:20.497672 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:20.497573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:20.659255 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:20.659220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:23.282233 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:23.282201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:23.373708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:23.373671 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:23.450533 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:23.450504 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:23.554998 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:23.554908 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:23.935619 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:23.935517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:24.034568 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:24.034531 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:27.147718 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:27.147683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:27.252756 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:27.252718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:27.799676 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:27.799614 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:28.285891 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:28.285862 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:28.583888 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:28.583798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:28.899478 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:28.899397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:31.318206 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:31.318177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:31.409849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:31.409787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:31.484148 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:31.484120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:31.825741 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:31.825710 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:32.051380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:32.051345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:32.152263 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:32.152180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:35.861851 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:35.861805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:44.048364 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:44.048324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:44.468989 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:44.468906 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:44.584708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:44.584616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:44.795829 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:44.795796 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:50.733814 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:50.733772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:50.797944 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:50.797909 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:50.999580 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:50.999529 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:51.232424 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:51.232393 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:51.392503 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:51.392413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:51.829178 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:51.829147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:51.928877 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:51.928840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:52.029810 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:52.029775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:52.173488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:52.173401 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:57.877554 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:57.877522 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:57.990939 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:57.990897 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:58.189630 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:58.189550 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:58.422154 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:58.422120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:58.767604 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:58.767568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:59.089319 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:59.089236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:47:59.323074 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:47:59.323041 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:02.507126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:02.507081 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:02.591129 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:02.591096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:02.664283 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:02.664246 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:02.827418 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:02.827333 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:03.164737 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:03.164633 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:03.262275 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:03.262242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:07.024396 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:07.024363 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:07.368530 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:07.368452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:07.701046 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:07.700950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:07.931814 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:07.931782 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:10.673234 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:10.673199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:10.749084 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:10.749044 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:10.828117 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:10.828083 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:11.121598 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:11.121567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:11.328865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:11.328836 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:11.429420 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:11.429336 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:15.212055 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:15.212006 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:23.888003 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:23.887913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:23.988584 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:23.988545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:31.287353 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:31.287319 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:33.133329 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:33.133297 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:33.234092 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:33.234059 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:48:54.120865 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:48:54.120830 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:49:01.611147 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:49:01.611114 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:49:01.619699 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:49:01.619677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:49:08.987434 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:49:08.987395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:50:27.633540 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:50:27.633501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:51:17.103992 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:51:17.103948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:51:18.646914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:51:18.646868 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:51:24.985464 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:51:24.985383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:51:38.113918 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:51:38.113882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:51:38.175680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:51:38.175627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:10.710267 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:10.710229 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:27.860574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:27.860530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:27.962001 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:27.961968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:34.664488 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:34.664457 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:52.066976 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:52.066937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:53.735849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:53.735753 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:54.587941 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:54.587894 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:52:58.912619 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:52:58.912584 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:24.788582 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:24.788544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:24.889645 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:24.889617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:33.865674 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:33.865612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:33.966158 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:33.966127 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:34.351142 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:34.351108 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:41.807896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:41.807859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:53:53.209253 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:53:53.209222 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:54:01.648574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:54:01.648540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:54:01.658965 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:54:01.658938 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:54:15.086340 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:54:15.086294 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:04.531388 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:04.531345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:05.491796 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:05.491759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:06.498392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.498357 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7523-140119918521008"] Jul 10 02:55:06.501870 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.501844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:06.504287 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.504268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-zzmwp\"" Jul 10 02:55:06.510015 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.509862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119918521008"] Jul 10 02:55:06.599689 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.599633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdg6\" (UniqueName: \"kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6\") pod \"test-curl-7523-140119918521008\" (UID: \"5d588a86-d1f0-496c-a1fd-26faedab35d3\") " pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:06.700335 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.700298 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdg6\" (UniqueName: \"kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6\") pod \"test-curl-7523-140119918521008\" (UID: \"5d588a86-d1f0-496c-a1fd-26faedab35d3\") " pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:06.708914 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.708886 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdg6\" (UniqueName: \"kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6\") pod \"test-curl-7523-140119918521008\" (UID: \"5d588a86-d1f0-496c-a1fd-26faedab35d3\") " pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:06.813368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.813339 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:06.955282 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.955258 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119918521008"] Jul 10 02:55:06.957675 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:55:06.957621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d588a86_d1f0_496c_a1fd_26faedab35d3.slice/crio-e02584387505f09e0bb9a4366021017163c152633649b44eae20d864cf9d29c3 WatchSource:0}: Error finding container e02584387505f09e0bb9a4366021017163c152633649b44eae20d864cf9d29c3: Status 404 returned error can't find the container with id e02584387505f09e0bb9a4366021017163c152633649b44eae20d864cf9d29c3 Jul 10 02:55:06.959456 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:06.959435 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 02:55:07.227955 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:07.227861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119918521008" event={"ID":"5d588a86-d1f0-496c-a1fd-26faedab35d3","Type":"ContainerStarted","Data":"e02584387505f09e0bb9a4366021017163c152633649b44eae20d864cf9d29c3"} Jul 10 02:55:08.235526 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:08.235491 2567 generic.go:356] "Generic (PLEG): container finished" podID="5d588a86-d1f0-496c-a1fd-26faedab35d3" containerID="5e1a947d162757896048da83e83352271a40b2a1e81bab2ea3b1c5338499e5f3" exitCode=0 Jul 10 02:55:08.235910 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:08.235548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119918521008" event={"ID":"5d588a86-d1f0-496c-a1fd-26faedab35d3","Type":"ContainerDied","Data":"5e1a947d162757896048da83e83352271a40b2a1e81bab2ea3b1c5338499e5f3"} Jul 10 02:55:09.387046 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.387021 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:09.407901 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.407867 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7523-140119918521008_5d588a86-d1f0-496c-a1fd-26faedab35d3/test-curl-7523-140119918521008/0.log" Jul 10 02:55:09.435502 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.435469 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7523-140119918521008"] Jul 10 02:55:09.439048 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.439019 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7523-140119918521008"] Jul 10 02:55:09.526871 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.526845 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smdg6\" (UniqueName: \"kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6\") pod \"5d588a86-d1f0-496c-a1fd-26faedab35d3\" (UID: \"5d588a86-d1f0-496c-a1fd-26faedab35d3\") " Jul 10 02:55:09.529036 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.529009 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6" (OuterVolumeSpecName: "kube-api-access-smdg6") pod "5d588a86-d1f0-496c-a1fd-26faedab35d3" (UID: "5d588a86-d1f0-496c-a1fd-26faedab35d3"). InnerVolumeSpecName "kube-api-access-smdg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:55:09.570496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.570470 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7523-140119918560688"] Jul 10 02:55:09.570895 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.570881 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d588a86-d1f0-496c-a1fd-26faedab35d3" containerName="test-curl-7523-140119918521008" Jul 10 02:55:09.570945 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.570897 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d588a86-d1f0-496c-a1fd-26faedab35d3" containerName="test-curl-7523-140119918521008" Jul 10 02:55:09.570981 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.570973 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d588a86-d1f0-496c-a1fd-26faedab35d3" containerName="test-curl-7523-140119918521008" Jul 10 02:55:09.573941 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.573927 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:09.580760 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.580721 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119918560688"] Jul 10 02:55:09.628225 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.628163 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smdg6\" (UniqueName: \"kubernetes.io/projected/5d588a86-d1f0-496c-a1fd-26faedab35d3-kube-api-access-smdg6\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:55:09.729138 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.729100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ltr\" (UniqueName: \"kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr\") pod \"test-curl-7523-140119918560688\" (UID: \"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e\") " pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:09.830179 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.830103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ltr\" (UniqueName: \"kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr\") pod \"test-curl-7523-140119918560688\" (UID: \"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e\") " pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:09.837933 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.837904 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ltr\" (UniqueName: \"kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr\") pod \"test-curl-7523-140119918560688\" (UID: \"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e\") " pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:09.883378 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:09.883357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:10.020065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:10.020041 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119918560688"] Jul 10 02:55:10.021401 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:55:10.021374 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33c1cbb2_84c0_4eb4_8dc3_a2dcb15cba5e.slice/crio-69969b49933994197156692fd05b292b5d1ff71dea5a1d772758059c98b59ba8 WatchSource:0}: Error finding container 69969b49933994197156692fd05b292b5d1ff71dea5a1d772758059c98b59ba8: Status 404 returned error can't find the container with id 69969b49933994197156692fd05b292b5d1ff71dea5a1d772758059c98b59ba8 Jul 10 02:55:10.248005 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:10.247912 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119918560688" event={"ID":"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e","Type":"ContainerStarted","Data":"69969b49933994197156692fd05b292b5d1ff71dea5a1d772758059c98b59ba8"} Jul 10 02:55:10.249317 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:10.249295 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918521008" Jul 10 02:55:10.249530 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:10.249296 2567 scope.go:117] "RemoveContainer" containerID="5e1a947d162757896048da83e83352271a40b2a1e81bab2ea3b1c5338499e5f3" Jul 10 02:55:11.256097 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:11.256063 2567 generic.go:356] "Generic (PLEG): container finished" podID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" containerID="baba978141f3dac88da173779f7e7534194152990aa3673b4a41564481d11c15" exitCode=0 Jul 10 02:55:11.256512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:11.256157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119918560688" event={"ID":"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e","Type":"ContainerDied","Data":"baba978141f3dac88da173779f7e7534194152990aa3673b4a41564481d11c15"} Jul 10 02:55:11.478896 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:11.478863 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d588a86-d1f0-496c-a1fd-26faedab35d3" path="/var/lib/kubelet/pods/5d588a86-d1f0-496c-a1fd-26faedab35d3/volumes" Jul 10 02:55:12.419637 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.419609 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:12.440328 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.440296 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7523-140119918560688_33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e/test-curl-7523-140119918560688/0.log" Jul 10 02:55:12.465247 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.465218 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7523-140119918560688"] Jul 10 02:55:12.469155 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.469127 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7523-140119918560688"] Jul 10 02:55:12.556596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.556510 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7ltr\" (UniqueName: \"kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr\") pod \"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e\" (UID: \"33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e\") " Jul 10 02:55:12.558784 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.558752 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr" (OuterVolumeSpecName: "kube-api-access-h7ltr") pod "33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" (UID: "33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e"). InnerVolumeSpecName "kube-api-access-h7ltr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:55:12.637507 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.637470 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:12.637970 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.637951 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" containerName="test-curl-7523-140119918560688" Jul 10 02:55:12.638017 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.637974 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" containerName="test-curl-7523-140119918560688" Jul 10 02:55:12.638082 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.638072 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" containerName="test-curl-7523-140119918560688" Jul 10 02:55:12.641319 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.641303 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:12.648995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.648967 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:12.658285 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.658258 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7ltr\" (UniqueName: \"kubernetes.io/projected/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e-kube-api-access-h7ltr\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:55:12.758985 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.758949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt55j\" (UniqueName: \"kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j\") pod \"test-curl-7523-140119920547712\" (UID: \"20b5c45a-1b08-4722-bcc3-1db5d3b984c8\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:12.860142 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.860057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt55j\" (UniqueName: \"kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j\") pod \"test-curl-7523-140119920547712\" (UID: \"20b5c45a-1b08-4722-bcc3-1db5d3b984c8\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:12.869510 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.869484 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt55j\" (UniqueName: \"kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j\") pod \"test-curl-7523-140119920547712\" (UID: \"20b5c45a-1b08-4722-bcc3-1db5d3b984c8\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:12.951256 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:12.951222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:13.092456 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:13.092431 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:13.093265 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:55:13.093239 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20b5c45a_1b08_4722_bcc3_1db5d3b984c8.slice/crio-4ad99d12ddbeecd548a2649d94152454547bf9415b9a9c1ddd492cb24147970d WatchSource:0}: Error finding container 4ad99d12ddbeecd548a2649d94152454547bf9415b9a9c1ddd492cb24147970d: Status 404 returned error can't find the container with id 4ad99d12ddbeecd548a2649d94152454547bf9415b9a9c1ddd492cb24147970d Jul 10 02:55:13.269398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:13.269368 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:13.269581 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:13.269415 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69969b49933994197156692fd05b292b5d1ff71dea5a1d772758059c98b59ba8" Jul 10 02:55:13.270671 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:13.270615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920547712" event={"ID":"20b5c45a-1b08-4722-bcc3-1db5d3b984c8","Type":"ContainerStarted","Data":"4ad99d12ddbeecd548a2649d94152454547bf9415b9a9c1ddd492cb24147970d"} Jul 10 02:55:13.280576 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:55:13.280552 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7523-140119918560688\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" pod="openshift-ingress/test-curl-7523-140119918560688" Jul 10 02:55:13.475825 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:13.475791 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e" path="/var/lib/kubelet/pods/33c1cbb2-84c0-4eb4-8dc3-a2dcb15cba5e/volumes" Jul 10 02:55:14.278009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:14.277974 2567 generic.go:356] "Generic (PLEG): container finished" podID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" containerID="dd5fb5f9a69c50b4c25bce736bda4bad5ac1eab751b1b9c3c77913f22ce92a1b" exitCode=0 Jul 10 02:55:14.278190 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:14.278039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920547712" event={"ID":"20b5c45a-1b08-4722-bcc3-1db5d3b984c8","Type":"ContainerDied","Data":"dd5fb5f9a69c50b4c25bce736bda4bad5ac1eab751b1b9c3c77913f22ce92a1b"} Jul 10 02:55:15.466729 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.466709 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:15.487790 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.487765 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7523-140119920547712_20b5c45a-1b08-4722-bcc3-1db5d3b984c8/test-curl-7523-140119920547712/0.log" Jul 10 02:55:15.512368 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.512337 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:15.517662 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.517622 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:15.585299 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.585225 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt55j\" (UniqueName: \"kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j\") pod \"20b5c45a-1b08-4722-bcc3-1db5d3b984c8\" (UID: \"20b5c45a-1b08-4722-bcc3-1db5d3b984c8\") " Jul 10 02:55:15.587536 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.587517 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j" (OuterVolumeSpecName: "kube-api-access-vt55j") pod "20b5c45a-1b08-4722-bcc3-1db5d3b984c8" (UID: "20b5c45a-1b08-4722-bcc3-1db5d3b984c8"). InnerVolumeSpecName "kube-api-access-vt55j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:55:15.643152 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.643119 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:15.643570 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.643556 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" containerName="test-curl-7523-140119920547712" Jul 10 02:55:15.643618 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.643571 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" containerName="test-curl-7523-140119920547712" Jul 10 02:55:15.643680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.643667 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" containerName="test-curl-7523-140119920547712" Jul 10 02:55:15.646690 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.646676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:15.653153 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.653131 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:15.686874 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.686851 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt55j\" (UniqueName: \"kubernetes.io/projected/20b5c45a-1b08-4722-bcc3-1db5d3b984c8-kube-api-access-vt55j\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:55:15.788007 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.787976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndkxl\" (UniqueName: \"kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl\") pod \"test-curl-7523-140119920547712\" (UID: \"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:15.889100 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.889018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndkxl\" (UniqueName: \"kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl\") pod \"test-curl-7523-140119920547712\" (UID: \"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:15.898155 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.898120 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndkxl\" (UniqueName: \"kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl\") pod \"test-curl-7523-140119920547712\" (UID: \"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd\") " pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:15.956899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:15.956868 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:16.096121 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:16.096070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:16.103083 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:55:16.103045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4609d0be_f9ab_4b59_b3e7_34d4b9d836cd.slice/crio-d26c9e3d2325f42d19cddeca4faf1f76cf23c02a72a12842f4e54e446d2d1553 WatchSource:0}: Error finding container d26c9e3d2325f42d19cddeca4faf1f76cf23c02a72a12842f4e54e446d2d1553: Status 404 returned error can't find the container with id d26c9e3d2325f42d19cddeca4faf1f76cf23c02a72a12842f4e54e446d2d1553 Jul 10 02:55:16.292070 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:16.292034 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:16.292251 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:16.292075 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad99d12ddbeecd548a2649d94152454547bf9415b9a9c1ddd492cb24147970d" Jul 10 02:55:16.293380 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:16.293353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920547712" event={"ID":"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd","Type":"ContainerStarted","Data":"d26c9e3d2325f42d19cddeca4faf1f76cf23c02a72a12842f4e54e446d2d1553"} Jul 10 02:55:16.304378 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:16.304349 2567 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7523-140119920547712" oldPodUID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" Jul 10 02:55:17.300036 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:17.299996 2567 generic.go:356] "Generic (PLEG): container finished" podID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" containerID="9c8e34156d15334813aa438b735198cea5c98f519aa8010338d0d54aa9938bd5" exitCode=0 Jul 10 02:55:17.300496 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:17.300041 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920547712" event={"ID":"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd","Type":"ContainerDied","Data":"9c8e34156d15334813aa438b735198cea5c98f519aa8010338d0d54aa9938bd5"} Jul 10 02:55:17.474417 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:17.474381 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20b5c45a-1b08-4722-bcc3-1db5d3b984c8" path="/var/lib/kubelet/pods/20b5c45a-1b08-4722-bcc3-1db5d3b984c8/volumes" Jul 10 02:55:18.464406 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.464382 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:18.487821 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.487789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7523-140119920547712_4609d0be-f9ab-4b59-b3e7-34d4b9d836cd/test-curl-7523-140119920547712/0.log" Jul 10 02:55:18.517703 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.517643 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:18.519927 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.519906 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7523-140119920547712"] Jul 10 02:55:18.612803 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.612716 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndkxl\" (UniqueName: \"kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl\") pod \"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd\" (UID: \"4609d0be-f9ab-4b59-b3e7-34d4b9d836cd\") " Jul 10 02:55:18.614958 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.614922 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl" (OuterVolumeSpecName: "kube-api-access-ndkxl") pod "4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" (UID: "4609d0be-f9ab-4b59-b3e7-34d4b9d836cd"). InnerVolumeSpecName "kube-api-access-ndkxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:55:18.655680 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.655639 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7523-140119920548720"] Jul 10 02:55:18.656086 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.656072 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" containerName="test-curl-7523-140119920547712" Jul 10 02:55:18.656086 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.656086 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" containerName="test-curl-7523-140119920547712" Jul 10 02:55:18.656170 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.656152 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" containerName="test-curl-7523-140119920547712" Jul 10 02:55:18.659202 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.659187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:18.663625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.663601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920548720"] Jul 10 02:55:18.714355 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.714328 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndkxl\" (UniqueName: \"kubernetes.io/projected/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd-kube-api-access-ndkxl\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:55:18.815211 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.815173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95\") pod \"test-curl-7523-140119920548720\" (UID: \"1dcaa348-aa1e-4f66-a832-0654b52971c4\") " pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:18.916455 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.916364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95\") pod \"test-curl-7523-140119920548720\" (UID: \"1dcaa348-aa1e-4f66-a832-0654b52971c4\") " pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:18.925392 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.925366 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95\") pod \"test-curl-7523-140119920548720\" (UID: \"1dcaa348-aa1e-4f66-a832-0654b52971c4\") " pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:18.970004 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:18.969975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:19.136203 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:19.136175 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7523-140119920548720"] Jul 10 02:55:19.137776 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:55:19.137749 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dcaa348_aa1e_4f66_a832_0654b52971c4.slice/crio-3741117a20eacf2173b0be12332afa9cdddd9fd02bee0899e3605f91d14180e4 WatchSource:0}: Error finding container 3741117a20eacf2173b0be12332afa9cdddd9fd02bee0899e3605f91d14180e4: Status 404 returned error can't find the container with id 3741117a20eacf2173b0be12332afa9cdddd9fd02bee0899e3605f91d14180e4 Jul 10 02:55:19.313793 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:19.313757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920548720" event={"ID":"1dcaa348-aa1e-4f66-a832-0654b52971c4","Type":"ContainerStarted","Data":"3741117a20eacf2173b0be12332afa9cdddd9fd02bee0899e3605f91d14180e4"} Jul 10 02:55:19.315182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:19.315159 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d26c9e3d2325f42d19cddeca4faf1f76cf23c02a72a12842f4e54e446d2d1553" Jul 10 02:55:19.315182 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:19.315169 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:19.329258 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:55:19.329230 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7523-140119920547712\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" pod="openshift-ingress/test-curl-7523-140119920547712" Jul 10 02:55:19.475895 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:19.475865 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4609d0be-f9ab-4b59-b3e7-34d4b9d836cd" path="/var/lib/kubelet/pods/4609d0be-f9ab-4b59-b3e7-34d4b9d836cd/volumes" Jul 10 02:55:20.322705 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:20.322638 2567 generic.go:356] "Generic (PLEG): container finished" podID="1dcaa348-aa1e-4f66-a832-0654b52971c4" containerID="ffbd21702d8ffb5e5e879c9019753445d62b512dbb5d98fdeef0f5031eb8d195" exitCode=0 Jul 10 02:55:20.322879 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:20.322701 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7523-140119920548720" event={"ID":"1dcaa348-aa1e-4f66-a832-0654b52971c4","Type":"ContainerDied","Data":"ffbd21702d8ffb5e5e879c9019753445d62b512dbb5d98fdeef0f5031eb8d195"} Jul 10 02:55:21.475104 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.475082 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:21.496927 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.496902 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7523-140119920548720_1dcaa348-aa1e-4f66-a832-0654b52971c4/test-curl-7523-140119920548720/0.log" Jul 10 02:55:21.528231 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.528200 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7523-140119920548720"] Jul 10 02:55:21.530688 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.530665 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7523-140119920548720"] Jul 10 02:55:21.639922 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.639826 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95\") pod \"1dcaa348-aa1e-4f66-a832-0654b52971c4\" (UID: \"1dcaa348-aa1e-4f66-a832-0654b52971c4\") " Jul 10 02:55:21.642119 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.642094 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95" (OuterVolumeSpecName: "kube-api-access-fpx95") pod "1dcaa348-aa1e-4f66-a832-0654b52971c4" (UID: "1dcaa348-aa1e-4f66-a832-0654b52971c4"). InnerVolumeSpecName "kube-api-access-fpx95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 02:55:21.740565 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:21.740529 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpx95\" (UniqueName: \"kubernetes.io/projected/1dcaa348-aa1e-4f66-a832-0654b52971c4-kube-api-access-fpx95\") on node \"ip-10-0-143-3.ec2.internal\" DevicePath \"\"" Jul 10 02:55:22.334710 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:22.334680 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:22.334710 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:22.334697 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3741117a20eacf2173b0be12332afa9cdddd9fd02bee0899e3605f91d14180e4" Jul 10 02:55:22.344607 ip-10-0-143-3 kubenswrapper[2567]: E0710 02:55:22.344569 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7523-140119920548720\" is forbidden: User \"system:node:ip-10-0-143-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-3.ec2.internal' and this object" podUID="1dcaa348-aa1e-4f66-a832-0654b52971c4" pod="openshift-ingress/test-curl-7523-140119920548720" Jul 10 02:55:23.474281 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:23.474246 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dcaa348-aa1e-4f66-a832-0654b52971c4" path="/var/lib/kubelet/pods/1dcaa348-aa1e-4f66-a832-0654b52971c4/volumes" Jul 10 02:55:24.811519 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:24.811488 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:25.248339 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:25.248252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:25.381156 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:25.381120 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:25.481383 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:25.481349 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:25.640150 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:25.640114 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:31.478323 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:31.478290 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:31.578544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:31.578501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:31.757109 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:31.757068 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.014342 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.014252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.190849 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.190820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.606797 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.606763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.707086 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.707049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.807484 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.807453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:32.933911 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:32.933837 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:38.679327 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:38.679282 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:38.742442 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:38.742411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:38.956035 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:38.955938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:39.211937 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:39.211856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:44.811609 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:44.811577 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hxzmz_d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0/manager/0.log" Jul 10 02:55:44.940175 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:44.940147 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-swc22_b23d7992-505a-4d8a-8a42-cfb78c19a9cc/manager/0.log" Jul 10 02:55:45.071626 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:45.071545 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55fc688ddd-mg7q7_e9dbd429-57da-4cb0-afda-95dd5388a2e9/manager/0.log" Jul 10 02:55:45.347933 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:45.347850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-96d2v_fbd63e21-8a3f-4292-b159-60ea573c20b4/manager/0.log" Jul 10 02:55:45.616726 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:45.616622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94f6fbcc5-6527m_1bf3055d-75ff-4968-8871-a1ea877493f5/copy-manifests/0.log" Jul 10 02:55:45.624094 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:45.624074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94f6fbcc5-6527m_1bf3055d-75ff-4968-8871-a1ea877493f5/manager/0.log" Jul 10 02:55:46.100541 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:46.100503 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7698785bc5-fldfw_5753aaa8-4f45-4fd4-aaf5-8bfa972bd6ca/maas-api/0.log" Jul 10 02:55:46.219258 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:46.219229 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-bhn7l_38a3a15b-6b4a-408e-8180-0307041e2af6/postgres/0.log" Jul 10 02:55:47.042916 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.042886 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/pull/0.log" Jul 10 02:55:47.051066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.051044 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/extract/0.log" Jul 10 02:55:47.061360 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.061329 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/util/0.log" Jul 10 02:55:47.182248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.182218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/extract/0.log" Jul 10 02:55:47.188639 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.188613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/util/0.log" Jul 10 02:55:47.194818 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.194800 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/pull/0.log" Jul 10 02:55:47.309893 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.309813 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/util/0.log" Jul 10 02:55:47.316917 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.316890 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/pull/0.log" Jul 10 02:55:47.323860 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.323842 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/extract/0.log" Jul 10 02:55:47.437026 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.436998 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/util/0.log" Jul 10 02:55:47.443787 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.443761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/pull/0.log" Jul 10 02:55:47.450286 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.450269 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/extract/0.log" Jul 10 02:55:47.692748 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.692644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nfx5w_219226ca-59da-4451-aae5-b193c665f09e/manager/0.log" Jul 10 02:55:47.808204 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.808176 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7dgzj_97d83d58-9bd3-4bbc-8365-b904e16e1074/manager/0.log" Jul 10 02:55:47.924643 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:47.924616 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jt26n_6c1d1f20-cbed-4049-bed3-5191ce190fce/kuadrant-console-plugin/0.log" Jul 10 02:55:48.051863 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:48.051832 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m2r8l_63b5903f-05f4-40ae-abe7-243c89c0eabd/registry-server/0.log" Jul 10 02:55:48.183633 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:48.183601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nxq9d_11b356b6-7e55-4831-a7bd-fd15efd4770c/manager/0.log" Jul 10 02:55:48.431708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:48.431629 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pbk88_4887e8af-b27a-45c9-bd0f-1d5f476c0f3b/manager/0.log" Jul 10 02:55:49.048958 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:49.048929 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779d665c94-fvd42_edb7fb69-f6e0-4781-8b2e-111929b252fb/kube-auth-proxy/0.log" Jul 10 02:55:49.417642 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:49.417573 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gtbmq_7b65d0a4-11bd-4b20-a4ca-6d5d8175e177/payload-pre-processing/0.log" Jul 10 02:55:49.537248 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:49.537216 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wgcxm_471019b9-49fc-49ae-8773-0746d28f2f4d/payload-processing/0.log" Jul 10 02:55:49.653582 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:49.653554 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bdbf6b7b-xklj9_38e39d45-a1e4-401c-a14f-a7b02bc6a6ed/router/0.log" Jul 10 02:55:50.147995 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:50.147963 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9jszp_e1c8a446-b6ad-4eb9-b358-17e65439cf41/main/0.log" Jul 10 02:55:50.396005 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:50.395977 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqgzfc_99218128-fb45-470e-8ed8-0672d39d9edf/main/0.log" Jul 10 02:55:50.516020 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:50.515995 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4wqz9_d415c8d0-bb47-44d1-aba8-22b54c44a9cb/main/0.log" Jul 10 02:55:54.952856 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:54.952781 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:55.012894 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:55.012865 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:56.991066 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:56.991037 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" limit=1024 Jul 10 02:55:57.553147 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:57.553114 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9xgbk_80aedb91-0c17-4538-9075-8a912b1e9e0f/global-pull-secret-syncer/0.log" Jul 10 02:55:57.682218 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:57.682191 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6nsr4_7a47d4a4-4b86-461a-8be3-37ad1a9aef04/konnectivity-agent/0.log" Jul 10 02:55:57.814554 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:55:57.814462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-3.ec2.internal_382efa3740e7079392d47b760e702167/haproxy/0.log" Jul 10 02:56:02.110710 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.110612 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/extract/0.log" Jul 10 02:56:02.135047 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.135015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/util/0.log" Jul 10 02:56:02.157745 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.157712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tb5mp_eba78049-d65e-46aa-acb4-2617c6d16b05/pull/0.log" Jul 10 02:56:02.203625 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.203592 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/extract/0.log" Jul 10 02:56:02.237855 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.237830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/util/0.log" Jul 10 02:56:02.260672 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.260624 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tvq92_46871f35-5ec2-4d6f-90ca-4417727da86d/pull/0.log" Jul 10 02:56:02.287062 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.287036 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/extract/0.log" Jul 10 02:56:02.308512 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.308482 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/util/0.log" Jul 10 02:56:02.329223 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.329190 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tl57m_3c0c72b7-ab02-404f-ad66-a47034697f6c/pull/0.log" Jul 10 02:56:02.363298 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.363218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/extract/0.log" Jul 10 02:56:02.403873 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.403844 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/util/0.log" Jul 10 02:56:02.433406 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.433378 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krzwm_093b8d59-ff26-4f71-ba04-739b6ab129d0/pull/0.log" Jul 10 02:56:02.850589 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.850557 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nfx5w_219226ca-59da-4451-aae5-b193c665f09e/manager/0.log" Jul 10 02:56:02.876084 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.876059 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7dgzj_97d83d58-9bd3-4bbc-8365-b904e16e1074/manager/0.log" Jul 10 02:56:02.908985 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.908958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jt26n_6c1d1f20-cbed-4049-bed3-5191ce190fce/kuadrant-console-plugin/0.log" Jul 10 02:56:02.949938 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:02.949908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m2r8l_63b5903f-05f4-40ae-abe7-243c89c0eabd/registry-server/0.log" Jul 10 02:56:03.066294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:03.066264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nxq9d_11b356b6-7e55-4831-a7bd-fd15efd4770c/manager/0.log" Jul 10 02:56:03.182302 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:03.182221 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pbk88_4887e8af-b27a-45c9-bd0f-1d5f476c0f3b/manager/0.log" Jul 10 02:56:04.939009 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:04.938975 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-2d4r8_7232669a-92fa-4b6b-a3e1-282cd60de248/cluster-monitoring-operator/0.log" Jul 10 02:56:05.213632 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:05.213555 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/node-exporter/0.log" Jul 10 02:56:05.234295 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:05.234269 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/kube-rbac-proxy/0.log" Jul 10 02:56:05.264360 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:05.264336 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6ftl_591496af-4920-4c51-b2f5-97a727d0eaef/init-textfile/0.log" Jul 10 02:56:07.603740 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.603696 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr"] Jul 10 02:56:07.604151 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.604136 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dcaa348-aa1e-4f66-a832-0654b52971c4" containerName="test-curl-7523-140119920548720" Jul 10 02:56:07.604195 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.604153 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dcaa348-aa1e-4f66-a832-0654b52971c4" containerName="test-curl-7523-140119920548720" Jul 10 02:56:07.604241 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.604231 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dcaa348-aa1e-4f66-a832-0654b52971c4" containerName="test-curl-7523-140119920548720" Jul 10 02:56:07.609144 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.609123 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.611394 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.611374 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdm6f\"/\"kube-root-ca.crt\"" Jul 10 02:56:07.612354 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.612335 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hdm6f\"/\"default-dockercfg-zhgkd\"" Jul 10 02:56:07.612428 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.612335 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdm6f\"/\"openshift-service-ca.crt\"" Jul 10 02:56:07.618451 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.618430 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr"] Jul 10 02:56:07.752882 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.752849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52fh\" (UniqueName: \"kubernetes.io/projected/c8f420cd-2733-46f6-ae05-2862e47ae1a8-kube-api-access-c52fh\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.753065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.752908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-sys\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.753065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.752934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-proc\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.753065 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.752959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-podres\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.753168 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.753061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-lib-modules\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.790544 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.790517 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/2.log" Jul 10 02:56:07.797676 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.797131 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gvffk_7e263ee6-46b2-4867-bc73-30942782931a/console-operator/3.log" Jul 10 02:56:07.853794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-lib-modules\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853794 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52fh\" (UniqueName: \"kubernetes.io/projected/c8f420cd-2733-46f6-ae05-2862e47ae1a8-kube-api-access-c52fh\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-sys\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-proc\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-podres\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-sys\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-lib-modules\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853943 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-proc\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.853966 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.853957 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8f420cd-2733-46f6-ae05-2862e47ae1a8-podres\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.861058 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.861040 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52fh\" (UniqueName: \"kubernetes.io/projected/c8f420cd-2733-46f6-ae05-2862e47ae1a8-kube-api-access-c52fh\") pod \"perf-node-gather-daemonset-qqsrr\" (UID: \"c8f420cd-2733-46f6-ae05-2862e47ae1a8\") " pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:07.920126 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:07.920098 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:08.067184 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.067156 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr"] Jul 10 02:56:08.068518 ip-10-0-143-3 kubenswrapper[2567]: W0710 02:56:08.068492 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8f420cd_2733_46f6_ae05_2862e47ae1a8.slice/crio-62bd8dc9516a129bfc7b84e50ef1b6609fa4645deccf8907a5ff60420694d018 WatchSource:0}: Error finding container 62bd8dc9516a129bfc7b84e50ef1b6609fa4645deccf8907a5ff60420694d018: Status 404 returned error can't find the container with id 62bd8dc9516a129bfc7b84e50ef1b6609fa4645deccf8907a5ff60420694d018 Jul 10 02:56:08.331708 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.331677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85cb76845-2qp9n_53ac8f6a-d2ef-42c4-be6c-3abc2d2a801e/console/0.log" Jul 10 02:56:08.600492 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.600451 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" event={"ID":"c8f420cd-2733-46f6-ae05-2862e47ae1a8","Type":"ContainerStarted","Data":"23e78aee77d5045f54d66f20d5ba68ba34e00bfa7df57754e092820ed85e4163"} Jul 10 02:56:08.600676 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.600514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" event={"ID":"c8f420cd-2733-46f6-ae05-2862e47ae1a8","Type":"ContainerStarted","Data":"62bd8dc9516a129bfc7b84e50ef1b6609fa4645deccf8907a5ff60420694d018"} Jul 10 02:56:08.600676 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.600545 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:08.619061 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.619018 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" podStartSLOduration=1.61900209 podStartE2EDuration="1.61900209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:56:08.616177879 +0000 UTC m=+2527.676582904" watchObservedRunningTime="2026-07-10 02:56:08.61900209 +0000 UTC m=+2527.679407116" Jul 10 02:56:08.922294 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:08.922213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-6vnr4_78cf255a-9570-4f62-9401-7ea708727f5e/volume-data-source-validator/0.log" Jul 10 02:56:09.928684 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:09.928636 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svxwv_51326654-a5b0-4e47-a740-4cba35bf85a1/dns/0.log" Jul 10 02:56:09.951401 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:09.951377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svxwv_51326654-a5b0-4e47-a740-4cba35bf85a1/kube-rbac-proxy/0.log" Jul 10 02:56:10.074596 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:10.074557 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qh9bh_8e5c9be1-aaa3-4feb-8dba-c7395ea64e75/dns-node-resolver/0.log" Jul 10 02:56:10.620711 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:10.620686 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6msk_e51de088-5c18-4515-bd39-a6a94b5fa19f/node-ca/0.log" Jul 10 02:56:11.723044 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:11.723015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779d665c94-fvd42_edb7fb69-f6e0-4781-8b2e-111929b252fb/kube-auth-proxy/0.log" Jul 10 02:56:11.836189 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:11.836157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gtbmq_7b65d0a4-11bd-4b20-a4ca-6d5d8175e177/payload-pre-processing/0.log" Jul 10 02:56:11.865626 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:11.865601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wgcxm_471019b9-49fc-49ae-8773-0746d28f2f4d/payload-processing/0.log" Jul 10 02:56:11.889122 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:11.889093 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bdbf6b7b-xklj9_38e39d45-a1e4-401c-a14f-a7b02bc6a6ed/router/0.log" Jul 10 02:56:12.551906 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:12.551874 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dtrqw_5458e934-ee21-47e2-9cfc-550c561603e5/serve-healthcheck-canary/0.log" Jul 10 02:56:13.047899 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:13.047872 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k9h6m_7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a/insights-operator/0.log" Jul 10 02:56:13.050378 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:13.050361 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-k9h6m_7df8bbc5-9959-4d05-ab4e-682c0c8d3a6a/insights-operator/1.log" Jul 10 02:56:13.072093 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:13.072074 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j489s_b760545f-ca99-40c9-86bc-30854cdf3e48/kube-rbac-proxy/0.log" Jul 10 02:56:13.092398 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:13.092383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j489s_b760545f-ca99-40c9-86bc-30854cdf3e48/exporter/0.log" Jul 10 02:56:13.113053 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:13.113030 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j489s_b760545f-ca99-40c9-86bc-30854cdf3e48/extractor/0.log" Jul 10 02:56:14.617431 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:14.617402 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hdm6f/perf-node-gather-daemonset-qqsrr" Jul 10 02:56:15.367317 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.367284 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hxzmz_d3db7cbe-dfdb-4e25-a1d6-a93d729aa4c0/manager/0.log" Jul 10 02:56:15.496790 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.496753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-swc22_b23d7992-505a-4d8a-8a42-cfb78c19a9cc/manager/0.log" Jul 10 02:56:15.585734 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.585708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55fc688ddd-mg7q7_e9dbd429-57da-4cb0-afda-95dd5388a2e9/manager/0.log" Jul 10 02:56:15.669744 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.669674 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-96d2v_fbd63e21-8a3f-4292-b159-60ea573c20b4/manager/0.log" Jul 10 02:56:15.779296 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.779261 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94f6fbcc5-6527m_1bf3055d-75ff-4968-8871-a1ea877493f5/manager/0.log" Jul 10 02:56:15.799408 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:15.799385 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94f6fbcc5-6527m_1bf3055d-75ff-4968-8871-a1ea877493f5/copy-manifests/0.log" Jul 10 02:56:17.218361 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:17.218256 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-68vrt_c2c67d76-9561-409d-8e10-cf8f0d44c54c/openshift-lws-operator/0.log" Jul 10 02:56:18.378556 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:18.378524 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779d665c94-fvd42_edb7fb69-f6e0-4781-8b2e-111929b252fb/kube-auth-proxy/0.log" Jul 10 02:56:18.473014 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:18.472979 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gtbmq_7b65d0a4-11bd-4b20-a4ca-6d5d8175e177/payload-pre-processing/0.log" Jul 10 02:56:18.492608 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:18.492583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wgcxm_471019b9-49fc-49ae-8773-0746d28f2f4d/payload-processing/0.log" Jul 10 02:56:18.506094 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:18.506076 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bdbf6b7b-xklj9_38e39d45-a1e4-401c-a14f-a7b02bc6a6ed/router/0.log" Jul 10 02:56:19.878853 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:19.878823 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779d665c94-fvd42_edb7fb69-f6e0-4781-8b2e-111929b252fb/kube-auth-proxy/0.log" Jul 10 02:56:19.970022 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:19.969989 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gtbmq_7b65d0a4-11bd-4b20-a4ca-6d5d8175e177/payload-pre-processing/0.log" Jul 10 02:56:19.991088 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:19.991058 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-wgcxm_471019b9-49fc-49ae-8773-0746d28f2f4d/payload-processing/0.log" Jul 10 02:56:20.006897 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:20.006862 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78bdbf6b7b-xklj9_38e39d45-a1e4-401c-a14f-a7b02bc6a6ed/router/0.log" Jul 10 02:56:22.659304 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:22.659258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-hj9jx_6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d/kube-storage-version-migrator-operator/1.log" Jul 10 02:56:22.660279 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:22.660261 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-hj9jx_6dda7f5f-4d7e-490c-bea3-ab5c9c145a6d/kube-storage-version-migrator-operator/0.log" Jul 10 02:56:23.634240 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.634212 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/kube-multus-additional-cni-plugins/0.log" Jul 10 02:56:23.655574 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.655540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/egress-router-binary-copy/0.log" Jul 10 02:56:23.676025 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.675999 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/cni-plugins/0.log" Jul 10 02:56:23.697017 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.696980 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/bond-cni-plugin/0.log" Jul 10 02:56:23.719188 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.719156 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/routeoverride-cni/0.log" Jul 10 02:56:23.742980 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.742959 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/whereabouts-cni-bincopy/0.log" Jul 10 02:56:23.765320 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:23.765296 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52dvb_75cbee37-71a5-4bb9-b29f-9874c3c1e358/whereabouts-cni/0.log" Jul 10 02:56:24.107836 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:24.107810 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d9fxp_6d3b5d3e-a44d-433a-ba2d-ac9d41684b76/kube-multus/0.log" Jul 10 02:56:24.201297 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:24.201269 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4mjq_bcf852c2-86fb-4722-9284-97be57533c80/network-metrics-daemon/0.log" Jul 10 02:56:24.221017 ip-10-0-143-3 kubenswrapper[2567]: I0710 02:56:24.220993 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b4mjq_bcf852c2-86fb-4722-9284-97be57533c80/kube-rbac-proxy/0.log"